-- Logs begin at Wed 2021-02-17 03:36:05 UTC, end at Wed 2021-02-17 04:56:05 UTC. -- Feb 17 04:23:42.064728 dv-cinder-759955-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 04:23:42.072437 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 04:23:42 2021] *** Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: nodename: dv-cinder-759955-5-iscsi Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: machine: x86_64 Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: clock source: unix Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: pcre jit disabled Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: detected number of CPU cores: 4 Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: current working directory: / Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: detected binary path: /usr/bin/uwsgi-core Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: dropping root privileges as early as possible Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: your processes number limit is 47843 Feb 17 04:23:42.074517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: your memory page size is 4096 bytes Feb 17 04:23:42.075700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: detected max file descriptor number: 2048 Feb 17 04:23:42.075700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: lock engine: pthread robust mutexes Feb 17 04:23:42.075700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: thunder lock: enabled Feb 17 04:23:42.075700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 04:23:42.075700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: dropping root privileges after socket binding Feb 17 04:23:42.075700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 04:23:42.119974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: Python main interpreter initialized at 0x560dceef19c0 Feb 17 04:23:42.119974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: dropping root privileges after plugin initialization Feb 17 04:23:42.119974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: python threads support enabled Feb 17 04:23:42.119974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: your server socket listen backlog is limited to 100 connections Feb 17 04:23:42.119974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: your mercy for graceful operations on workers is 90 seconds Feb 17 04:23:42.120443 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 04:23:42.120443 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: *** Operational MODE: preforking *** Feb 17 04:23:42.120615 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: dropping root privileges after application loading Feb 17 04:23:42.120615 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: *** uWSGI is running in multiple interpreter mode *** Feb 17 04:23:42.120615 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: spawned uWSGI master process (pid: 83353) Feb 17 04:23:42.120758 dv-cinder-759955-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 04:23:42.121073 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: spawned uWSGI worker 1 (pid: 83354, cores: 1) Feb 17 04:23:42.125741 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: spawned uWSGI worker 2 (pid: 83355, cores: 1) Feb 17 04:23:42.125741 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 04:23:46.553476 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:23:46.554056 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:23:46.554160 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:23:46.554236 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:23:46.555349 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:23:46.555479 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:23:46.555785 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:23:46.555900 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:23:46.556079 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:23:46.556179 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:23:46.556539 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.556643 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.556908 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.557013 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.557299 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.557404 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.557657 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.558014 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.558284 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.558394 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.558638 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.558752 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.559006 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.559113 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.559380 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.559483 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.559758 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.559856 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.560048 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.560158 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.560401 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.560510 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.560763 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759955-5-iscsi {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.560867 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759955-5-iscsi {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.561126 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.561245 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.561470 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.561579 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.561810 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.561909 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.562164 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.562262 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.562501 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.562599 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.562861 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.562967 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.563202 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.563353 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.563833 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.563949 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.564187 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.564287 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.564527 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.564626 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.564869 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.564966 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.565252 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.565370 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.565596 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.565751 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.565997 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.566095 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.566361 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.566468 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.566701 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.566807 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.567064 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.567161 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.567444 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.567557 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.567804 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759955-5-iscsi {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.567909 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759955-5-iscsi {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.568154 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.568260 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.568494 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.568599 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.568843 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.568952 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.569318 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.569428 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.569666 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.569765 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.570004 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.570102 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.570367 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.570485 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.570724 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.570823 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.571066 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.571164 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.571461 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.571645 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.571830 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.571937 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.572191 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.572290 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.572548 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.572654 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.572885 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.572984 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.573223 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.573321 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.573566 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.573675 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.573919 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574024 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574260 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574358 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574603 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574883 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.574983 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.575222 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.575507 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.575610 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.575717 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.575965 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.576071 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.576340 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.576447 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.576620 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.576719 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.576899 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.577009 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.577258 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.577357 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.577624 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.577723 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.577970 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.578069 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.578309 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.578407 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.578645 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.578743 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.578984 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.579083 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.579354 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.579457 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.579701 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.579809 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.580041 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.580146 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.580378 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.580477 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.580738 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.580836 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.581090 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.581188 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.581958 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.582067 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.582304 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.582409 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.582668 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.582773 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.583112 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.583209 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.583428 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.583553 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.583776 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.583882 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.584157 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.584260 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.584516 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.584626 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.584862 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.584965 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.585243 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.585392 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.585580 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.585690 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.585921 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.586020 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.586260 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.586369 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.586606 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.586713 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.586967 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.587066 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.587363 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.587468 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.587709 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.587820 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.587990 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.588095 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.588323 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.588428 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.588662 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.588762 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.589015 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.589119 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.589355 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.589454 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.589693 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.589792 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.590029 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.590128 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.590360 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.590458 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.590698 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.590798 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.591033 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.591138 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.591397 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.591499 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.591740 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.591840 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.592084 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.592228 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.592414 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.592522 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.592754 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.592861 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.593091 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.593189 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.593427 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.593588 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.593782 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.593880 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.594142 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.594244 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.594478 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.594583 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.594817 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.594914 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.595155 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.595257 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.595531 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.595634 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.595886 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.596030 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.596219 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.596318 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.596556 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.596662 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.597469 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.597578 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.597808 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.597911 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.598152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.598256 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.598512 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.598608 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.598848 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.598950 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.599189 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.599308 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.599567 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.599674 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.599902 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.600011 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.600240 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.600338 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.600598 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.600694 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.600935 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.601031 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.601273 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.601370 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.601606 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.601703 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.601941 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.602053 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.602275 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.602391 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.602608 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.602704 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.602941 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.603045 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.603304 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.603407 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.603640 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.603738 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.603997 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.604100 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.604356 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.604459 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.604696 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.604793 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.605033 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.605137 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.605368 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.605471 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.605723 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.605830 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:23:46.606088 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.606199 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.606459 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.606557 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.606839 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.606936 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.607185 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.607300 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.607585 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.607693 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.607965 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.608062 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.608316 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.608419 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.608663 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.608764 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.609008 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.609105 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.609370 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.609467 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.609715 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.609811 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.610058 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.610162 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.610402 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.610498 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.610757 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.610859 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.611108 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.611214 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.611515 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.611622 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.611868 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.611965 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.612217 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.612353 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.612591 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.612690 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.612944 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.613048 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.613295 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.613398 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.613660 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.613757 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.614021 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.614124 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.614366 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.614468 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.614744 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.614842 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.615125 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.615230 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.615497 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.615594 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.615861 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.615968 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.616205 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.616309 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.616570 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.616667 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.616923 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.617021 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.617266 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.617363 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.617613 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.617710 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.617960 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.618065 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.618306 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.618413 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.618644 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.618742 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.619026 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.619125 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.619401 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.619502 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.619759 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.619872 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.620098 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.620197 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.620436 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.620539 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.620773 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.620877 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.621115 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.621212 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.621451 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.621552 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.621803 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.621907 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.622169 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.622298 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.622492 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.622622 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.622867 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.622980 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.623207 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.623356 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.623586 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.623687 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.623931 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.624032 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.624267 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.624367 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.624613 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.624712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.624961 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.625068 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.625297 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.625398 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.625656 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.625770 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.626017 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.626124 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.626317 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.626426 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.626670 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.626769 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.627009 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.627115 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.627366 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.627474 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.627718 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.627819 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.628059 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.628160 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.628430 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.628531 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.628773 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.628881 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.629134 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.629234 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.629478 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.629577 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.629820 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.629934 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.630202 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.630308 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.630579 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.630684 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.630919 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.631031 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.631347 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.631460 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.631670 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.631770 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.632018 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.632132 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.632357 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.632522 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.632671 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.632822 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633012 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633172 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633337 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633483 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633663 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633811 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.633970 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.634116 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.634314 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.634461 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.634618 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.634777 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.634929 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.635074 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.635314 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.635435 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.635640 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.635738 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.636074 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.636185 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.636348 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.636445 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.636702 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.636799 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.637047 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.637151 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.637381 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.637483 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.637763 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.637868 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.638098 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.638195 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.638472 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.638569 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.638816 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.638920 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.639171 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.639269 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.639557 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.639658 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.639900 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.640010 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.640237 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.640334 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.640572 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.640670 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.640913 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.641020 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.641272 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.641369 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.641611 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.641728 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.641953 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.642077 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.642289 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.642404 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.642689 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.642821 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.642979 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.643107 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.643372 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.643494 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.644202 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.644328 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.644583 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.644707 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.644944 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.645060 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.645293 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.645409 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.645636 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.645753 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.645983 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.646099 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.646303 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.646416 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.646637 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.646760 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.646978 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.647102 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.647333 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.647459 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.647689 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.647838 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.648034 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.648156 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.648374 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.648522 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.648721 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.648873 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649093 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649250 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649387 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649588 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649725 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649858 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.649992 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.650100 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.650356 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.650482 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.650702 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.650847 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.651062 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.651178 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.651451 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.651609 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.651794 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.651939 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.652133 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.652273 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.652494 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.652641 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.652858 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653004 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653139 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653273 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653473 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653613 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653808 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.653952 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.654193 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.654333 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.654534 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.654675 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.654872 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.655010 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.655218 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.655386 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.655608 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.655749 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.655951 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.656089 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.656367 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.656519 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.656670 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.656806 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.656946 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.657083 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.657295 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.657441 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.657644 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.657782 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.657985 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.658123 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.658328 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.658473 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.658669 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.658807 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.659013 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.659150 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.659401 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.659554 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.659798 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.659947 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.660140 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.660279 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.660485 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.660634 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.660826 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.660965 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.661237 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.661375 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.661517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.661651 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.661784 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.661922 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.662480 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.662618 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.662917 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.663065 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.663207 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.663380 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.663556 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.663700 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.663912 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.664051 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.664264 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.664401 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.664634 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.664778 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.664996 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.665135 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.665341 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.665485 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.665679 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.665825 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.666024 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.666163 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.666362 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.666544 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.666680 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.666822 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.667029 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.667167 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.667391 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.667532 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.667730 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.667879 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.668067 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.668205 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.668409 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.668547 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.668743 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.668891 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.669079 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.669223 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.669415 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.669552 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.669750 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.669896 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.670097 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.670234 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.670434 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.670572 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.670777 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.670922 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.671113 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.671263 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.671506 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.671647 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.671794 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.671928 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.672137 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.672275 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.672475 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.672620 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.672810 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.672962 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.673161 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.673299 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.673508 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.673647 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.673888 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.674035 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.674257 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.674394 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.674638 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.674777 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.675490 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.675646 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.675857 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.675995 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.676229 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.676375 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.676570 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.676708 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.676904 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.677042 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.677249 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.677407 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.677663 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.677803 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.677943 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.678082 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.678218 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.678359 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.678546 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.678684 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.678888 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.679025 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.679221 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.679399 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.679596 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.679735 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.679936 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.680078 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.680286 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.680425 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.680625 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.680763 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.680960 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.681098 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.681296 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.681446 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.681646 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.681783 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.681958 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.682097 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.682293 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.682429 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.682636 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.683023 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.683236 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.683410 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.683605 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.683744 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.683951 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.684090 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.684285 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.684423 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.684622 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.684761 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.684961 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.685105 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.685324 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.685470 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.685673 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.685811 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.686009 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.686153 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.686351 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.686499 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.686688 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.686826 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.687025 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.687164 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.687390 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.687545 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.687759 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.687903 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.688043 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.688177 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.688375 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.688521 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.688712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.688851 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.689048 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.689186 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.689386 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.689532 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.689745 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.689883 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.690087 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.690225 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.690422 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.690566 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.691348 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.691495 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.691712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.691857 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.692064 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.692204 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.692404 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.692543 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.692809 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.692947 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.693150 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.693290 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.693498 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.693637 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.693853 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.693992 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.694199 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.694345 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.694538 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.694676 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.694891 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.695029 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.695235 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.695394 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.695610 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.695749 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.695952 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.696103 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.696288 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.696432 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.696647 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.696786 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.696988 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.697137 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.697331 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.697470 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.697686 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.697837 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.698037 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.698182 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.698393 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.698530 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.698732 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.698869 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.699074 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.699220 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.699448 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.699588 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.699790 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.699927 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.700137 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.700275 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.700477 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.700614 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.700821 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.700959 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.701163 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.701301 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.701505 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.701642 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.701854 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702000 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702147 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702288 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702492 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702631 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702834 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.702974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.703177 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.703377 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.703554 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.703703 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.703917 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.704062 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.704259 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.704376 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.704593 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.704708 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.704936 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.705086 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.705270 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.705385 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.705614 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.705753 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.705955 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.706103 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.706669 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.706765 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.706858 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.706950 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.707126 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.707225 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.707492 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.707591 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.707842 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.707955 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.708188 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.708298 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.708539 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.708636 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.708886 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.708995 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.709215 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.709439 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.709683 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.709955 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.710052 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.710310 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.710409 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.710660 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.710763 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.711008 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.711110 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.711387 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.711489 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.711733 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.711831 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.712085 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.712202 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.712422 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.712525 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.712767 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.712865 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.713108 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.713216 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.713443 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.713541 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.713798 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.713896 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.714136 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.714241 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.714501 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.714599 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.714941 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.715039 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.715337 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.715450 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.715655 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.715789 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.716134 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.716232 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.716486 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.716584 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.716837 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.716935 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.717199 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.717296 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.717557 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.717678 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.717901 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.717998 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.718247 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.718387 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.718593 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.718750 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.718932 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.719084 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.719320 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.719470 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.719674 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.719776 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.720019 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.720119 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.720358 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.720455 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.720694 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.720793 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.721064 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.721167 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.721411 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.721516 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.721758 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.721877 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.722152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.722282 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.722598 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.722703 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.722954 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.723056 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.723320 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.723431 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.723688 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.723807 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.724028 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.724142 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.724377 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.724473 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.724714 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.724821 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.725052 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.725150 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.725388 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.725484 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.725734 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.725832 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.726072 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.726174 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.726425 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.726521 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.726769 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.726891 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.727113 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.727210 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.727491 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.727591 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.727830 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.727929 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.728176 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.728285 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.728515 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.728623 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.728858 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.728965 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.729214 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.729314 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.729560 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.729663 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.729925 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.730029 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.730274 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.730372 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.730611 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.730768 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.730968 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.731066 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.731344 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.731524 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.731669 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.731775 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.732002 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.732099 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.732348 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.732464 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.732707 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.732814 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.733051 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.733149 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.733411 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.733508 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.733783 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.733889 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.734139 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.734255 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.734479 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.734578 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.734856 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.734954 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.735207 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.735330 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.735585 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.735683 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.735952 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.736051 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.736303 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.736422 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.736631 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.736729 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.736974 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.737073 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.737320 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.737459 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.738141 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.738241 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.738506 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.738673 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.738815 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.738896 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.739152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.739253 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.739514 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.739625 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.739850 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.739949 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.740183 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.740287 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.740538 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.740675 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.740873 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.740972 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.741230 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.741329 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.741570 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.741675 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.741906 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.742010 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.742240 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.742351 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.742586 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.742702 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.742943 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.743042 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.743344 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.743464 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.743689 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.743796 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.744047 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.744145 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.744411 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.744576 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.744763 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.744863 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.745135 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.745241 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.745497 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.745603 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.745857 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.745956 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.746210 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.746308 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.746565 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.746675 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.746916 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.747014 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.747265 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.747395 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.747645 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.747759 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.747994 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.748103 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.748346 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.748444 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.748694 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.748806 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.749107 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.749227 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.749392 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.749654 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.749992 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.750092 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.750363 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.750462 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.750713 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.750811 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.751068 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.751168 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.751451 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.751553 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.751800 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.751914 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.752148 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.752248 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.752492 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.752609 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.752838 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.753014 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.753228 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.753335 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.753574 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.753673 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.753918 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.754023 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.754291 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.754396 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.754661 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.754776 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.755030 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.755140 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.755409 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.755512 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.755767 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.755874 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.756123 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.756223 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.756478 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.756585 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.756831 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.756929 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.757230 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.757329 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.757581 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.757686 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.757921 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.758026 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.758283 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.758381 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.758638 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.758743 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.758992 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.759102 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.759369 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.759490 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.759722 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.759827 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.760073 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.760180 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.760426 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.760524 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.760773 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.760871 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.761119 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.761218 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.761461 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.761559 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.761814 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.761913 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.762188 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.762293 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.762543 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.762641 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.762903 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.763036 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.763246 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.763383 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.763621 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.763724 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.763982 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.764213 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.764569 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.764671 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.764913 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.765013 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.765288 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.765397 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.765650 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.765751 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.766006 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.766106 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.766360 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.766468 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.766704 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.766805 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.767045 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.767152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.767411 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.767534 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.767749 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.767850 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.768096 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.768197 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.768435 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.768544 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.769348 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.769461 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.769630 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.769719 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.769969 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.770081 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.770302 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.770403 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.770652 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.770753 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.770992 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.771265 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.771628 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.771729 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.772020 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.772121 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.772370 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.772486 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.772739 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.772846 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.773101 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.773203 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.773449 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.773551 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.773786 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.773886 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.774139 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.774251 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.774478 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.774578 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.774824 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.774924 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.775166 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.775275 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.775539 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.775641 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.775875 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.775977 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.776209 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.776321 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.776551 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.776652 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.776896 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777000 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777230 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777338 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777565 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777666 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777896 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.777996 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.778250 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.778358 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.778587 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.778687 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.778925 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.779032 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.779259 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.779402 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.779625 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.779737 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.779958 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.780059 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.780297 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.780399 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.780633 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.780733 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.780977 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.781090 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.781314 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.781420 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.781648 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.781749 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.781985 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.782085 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.782320 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.782427 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.782656 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.782756 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.782990 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.783090 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.783347 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.783460 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.783688 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.783800 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.784039 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.784151 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.784395 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.785007 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.785281 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.785388 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.785639 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.785751 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.785988 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.786088 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.786336 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.786436 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.786681 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.786845 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.787038 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.787138 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.787427 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.787530 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.787790 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.788055 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.788405 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.788505 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.788784 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.788885 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.789147 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.789248 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.789537 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.789752 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.789856 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.789959 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.790209 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.790319 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.790557 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.790657 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.790901 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.791002 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.791248 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.791382 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.791621 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.791721 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.791964 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.792065 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.792307 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.792408 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.792652 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.792755 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.792990 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.793099 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.793338 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.793465 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.793677 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.793779 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.794018 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.794133 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.794357 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.794456 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.794705 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.794803 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.795069 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.795177 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.795447 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.795550 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.795807 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.795907 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.796155 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.796263 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.796502 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.796600 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.796846 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.796944 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.797188 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.797288 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.797532 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.797630 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.797872 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.797976 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.798229 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.798334 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.798583 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.798681 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.798929 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.799027 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.799289 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.799392 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.799822 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800009 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800164 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800325 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800476 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800625 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800773 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.800921 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.801108 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.801265 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.801482 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.801647 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.801864 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.802022 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.802230 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.802393 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.802577 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.802724 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.802912 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.803075 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.803223 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.803352 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.803645 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.803809 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.803959 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.804108 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.804316 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.804485 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.804677 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.804839 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.805031 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.805182 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.805397 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.805559 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.805748 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.805898 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.806101 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.806251 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.806416 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.806576 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.806772 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.806926 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.807085 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.807249 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.807485 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.807635 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.808086 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.808196 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.808436 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.808537 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.808788 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.808890 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.809128 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.809229 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.809493 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.809602 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.809836 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.809989 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.810175 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.810276 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.810510 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.810623 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.810859 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.810960 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.811200 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.811333 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.811582 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.811693 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.811936 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.812037 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.812291 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.812391 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.812635 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.812788 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.812978 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.813080 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.813329 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.813436 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.813668 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.813778 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.814031 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.814132 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.814380 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.814514 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.814728 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.814831 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.815075 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.815184 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.815489 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.815593 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.815861 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.815963 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.816212 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.817038 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.817405 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.817512 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.817769 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.817870 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.818127 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.818228 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.818490 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.818599 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.818869 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.818969 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.819227 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.819396 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.819604 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.819717 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.819984 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.820132 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.820348 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.820450 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.820706 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.820876 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.821057 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.821158 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.821407 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.821508 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.821774 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.821876 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.822124 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.822224 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.822473 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.822574 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.822817 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.822919 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.823169 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.823270 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.823555 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.823657 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.823909 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.824015 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.824282 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.824391 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.824646 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.824758 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.825014 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.825114 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.825378 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.825485 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.825740 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.825849 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.826096 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.826196 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.826486 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.826586 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.826770 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83354) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:23:46.826879 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:23:46.827114 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:23:46.940593 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83354) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:46.941450 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.200225 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.context [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed6ce518-2f7d-44db-9afc-ecf963cec3c5(cell1) {{(pid=83355) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:23:47.200528 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.context [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed6ce518-2f7d-44db-9afc-ecf963cec3c5(cell1) {{(pid=83354) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:23:47.205682 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:23:47.205815 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83354) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:23:47.208146 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:23:47.208330 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=83354) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:23:47.209028 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:23:47.209212 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83354) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:23:47.211137 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:23:47.211361 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83354) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:23:47.238725 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.239652 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.241306 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83354) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.242192 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83354) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.272400 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.275128 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83354) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:23:47.401345 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:23:47.401345 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: from cryptography.utils import int_from_bytes Feb 17 04:23:47.401729 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:23:47.401729 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: from cryptography.utils import int_from_bytes Feb 17 04:23:47.414515 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:23:47.414515 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: from cryptography.utils import int_from_bytes Feb 17 04:23:47.414897 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:23:47.414897 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: from cryptography.utils import int_from_bytes Feb 17 04:23:47.477990 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading Gnome Feb 17 04:23:47.492548 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading Gnome Feb 17 04:23:47.498428 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading Google Feb 17 04:23:47.501792 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading Windows (alt) Feb 17 04:23:47.506657 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading file Feb 17 04:23:47.507766 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading keyczar Feb 17 04:23:47.508257 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading multi Feb 17 04:23:47.509114 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Loading pyfs Feb 17 04:23:47.512334 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading Google Feb 17 04:23:47.515716 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading Windows (alt) Feb 17 04:23:47.520705 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading file Feb 17 04:23:47.521814 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading keyczar Feb 17 04:23:47.522253 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading multi Feb 17 04:23:47.523105 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO keyring.backend [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Loading pyfs Feb 17 04:23:47.789282 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:23:47.796429 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:23:47.799801 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:23:47.807032 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:23:48.130899 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:23:48.136599 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:23:48.140289 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:23:48.141929 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dceef19c0 pid: 83355 (default app) Feb 17 04:23:48.144875 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:23:48.146080 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-5ab1c922-cfa3-4bea-bbd5-ed7e4c85a1e3 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002406 Feb 17 04:23:48.146515 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 779 bytes} [Wed Feb 17 04:23:48 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:23:48.146622 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WARNING keystonemiddleware.auth_token [None req-149bebd9-424c-4a2c-930a-758979035bc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:23:48.151907 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dceef19c0 pid: 83354 (default app) Feb 17 04:25:15.007663 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-718c4d40-07dd-406f-b4b2-1c0b145da233 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:15.032768 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-718c4d40-07dd-406f-b4b2-1c0b145da233 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.502167 Feb 17 04:25:15.033371 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 2/2] 10.222.0.73 () {58 vars in 1150 bytes} [Wed Feb 17 04:25:14 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:17.877953 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-9c407c93-11ff-4b0e-adda-8e60f05b339a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:17.902577 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:25:17.902577 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:25:17.960002 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-9c407c93-11ff-4b0e-adda-8e60f05b339a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.423986 Feb 17 04:25:17.960626 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 1/3] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:17 2021] POST /compute/v2.1/flavors => generated 367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:17.971800 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-27f8ccdc-c02f-47e9-a7ea-5183399ca6fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:17.974596 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:25:17.974596 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:25:18.036819 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-27f8ccdc-c02f-47e9-a7ea-5183399ca6fa admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.068528 Feb 17 04:25:18.037436 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 3/4] 10.222.0.73 () {62 vars in 1236 bytes} [Wed Feb 17 04:25:17 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:18.047719 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-792dd288-b7d5-4c67-bf5f-9ec12ea2af9f admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:18.065016 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-792dd288-b7d5-4c67-bf5f-9ec12ea2af9f admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.021359 Feb 17 04:25:18.065581 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 2/5] 10.222.0.73 () {58 vars in 1183 bytes} [Wed Feb 17 04:25:18 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:20.619782 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-3804720b-b46f-4ec4-b38c-aaf8cebdc96f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:20.643036 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:25:20.643036 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:25:20.725038 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-3804720b-b46f-4ec4-b38c-aaf8cebdc96f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.159022 Feb 17 04:25:20.725671 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 4/6] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:20 2021] POST /compute/v2.1/flavors => generated 364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:20.736600 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-13f754f2-b19e-46de-8c09-874b97379fb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:20.738193 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:25:20.738193 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:25:20.838586 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-13f754f2-b19e-46de-8c09-874b97379fb4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.105871 Feb 17 04:25:20.839208 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 3/7] 10.222.0.73 () {62 vars in 1236 bytes} [Wed Feb 17 04:25:20 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:20.849275 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-a71fe282-f606-431d-913d-517449143fab admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:20.864589 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-a71fe282-f606-431d-913d-517449143fab admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019196 Feb 17 04:25:20.865150 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 5/8] 10.222.0.73 () {58 vars in 1183 bytes} [Wed Feb 17 04:25:20 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:23.404549 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-ccf91f71-5169-4a19-9c52-ff9d043213c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:23.497106 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-ccf91f71-5169-4a19-9c52-ff9d043213c6 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.145505 Feb 17 04:25:23.497642 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 4/9] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:23 2021] POST /compute/v2.1/flavors => generated 364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:23.509017 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-809fbec9-3496-402b-b463-280e1599ef44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:23.586154 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-809fbec9-3496-402b-b463-280e1599ef44 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.081583 Feb 17 04:25:23.586754 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 6/10] 10.222.0.73 () {62 vars in 1236 bytes} [Wed Feb 17 04:25:23 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:23.596679 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-06729ca6-c2ec-49c3-8e2d-ba3fdd53efe7 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:23.612152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-06729ca6-c2ec-49c3-8e2d-ba3fdd53efe7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019322 Feb 17 04:25:23.612712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 5/11] 10.222.0.73 () {58 vars in 1183 bytes} [Wed Feb 17 04:25:23 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:26.217482 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-a2148c3c-e85c-4e22-891f-a26eee35a855 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:26.275861 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-a2148c3c-e85c-4e22-891f-a26eee35a855 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.113286 Feb 17 04:25:26.276460 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 7/12] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:26 2021] POST /compute/v2.1/flavors => generated 364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:26.287622 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-40b87a2b-3a5f-4b05-9111-556f5eecf4c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:26.359831 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-40b87a2b-3a5f-4b05-9111-556f5eecf4c1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.076169 Feb 17 04:25:26.360427 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 6/13] 10.222.0.73 () {62 vars in 1236 bytes} [Wed Feb 17 04:25:26 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:26.371084 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-2b897d26-1a50-4f5c-8da3-eb3c3954db48 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:26.388390 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-2b897d26-1a50-4f5c-8da3-eb3c3954db48 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.021290 Feb 17 04:25:26.388953 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 8/14] 10.222.0.73 () {58 vars in 1183 bytes} [Wed Feb 17 04:25:26 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:28.938973 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-30a28e76-e4ba-4243-93c0-46adaf1a873c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:28.997397 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-30a28e76-e4ba-4243-93c0-46adaf1a873c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.112068 Feb 17 04:25:28.998021 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 7/15] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:28 2021] POST /compute/v2.1/flavors => generated 364 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:29.009242 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-97eefdda-df31-447d-9547-5407ee9e5b2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:29.074417 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-97eefdda-df31-447d-9547-5407ee9e5b2e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.069068 Feb 17 04:25:29.075008 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 9/16] 10.222.0.73 () {62 vars in 1236 bytes} [Wed Feb 17 04:25:29 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:29.085455 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-faae6fd1-ce4a-4ade-af79-179f09b64463 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:29.100768 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-faae6fd1-ce4a-4ade-af79-179f09b64463 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019861 Feb 17 04:25:29.101324 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 8/17] 10.222.0.73 () {58 vars in 1183 bytes} [Wed Feb 17 04:25:29 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:31.669354 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-0b42e7a1-0b01-4dd1-8cf0-be4b4f858bb4 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:31.690913 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-0b42e7a1-0b01-4dd1-8cf0-be4b4f858bb4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.077128 Feb 17 04:25:31.691552 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 10/18] 10.222.0.73 () {58 vars in 1150 bytes} [Wed Feb 17 04:25:31 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:25:34.270805 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-c5082609-cdbb-4f3e-8b0e-21545ab89c63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:34.327044 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-c5082609-cdbb-4f3e-8b0e-21545ab89c63 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.109717 Feb 17 04:25:34.327680 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 9/19] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:34 2021] POST /compute/v2.1/flavors => generated 362 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:34.338694 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-08a9f147-f791-43fd-adb0-4c03d5891f8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:34.406191 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-08a9f147-f791-43fd-adb0-4c03d5891f8c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071341 Feb 17 04:25:34.406739 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 11/20] 10.222.0.73 () {62 vars in 1233 bytes} [Wed Feb 17 04:25:34 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:34.417140 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-4e3e9690-183f-474a-8900-9646fc9fe2b8 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:34.432379 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-4e3e9690-183f-474a-8900-9646fc9fe2b8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019129 Feb 17 04:25:34.432933 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 10/21] 10.222.0.73 () {58 vars in 1180 bytes} [Wed Feb 17 04:25:34 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:37.006567 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-07ad59f3-3336-443a-ab6d-482570549344 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:37.068768 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-07ad59f3-3336-443a-ab6d-482570549344 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.117700 Feb 17 04:25:37.069378 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 12/22] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:36 2021] POST /compute/v2.1/flavors => generated 365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:37.080320 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-832da616-d221-4e1b-923c-02b65c1fe237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:37.141101 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-832da616-d221-4e1b-923c-02b65c1fe237 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.064689 Feb 17 04:25:37.141712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 11/23] 10.222.0.73 () {62 vars in 1233 bytes} [Wed Feb 17 04:25:37 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:37.151849 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-b4e987bc-81cb-4450-8510-5c817240d1c8 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:37.167578 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-b4e987bc-81cb-4450-8510-5c817240d1c8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019777 Feb 17 04:25:37.168142 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 13/24] 10.222.0.73 () {58 vars in 1180 bytes} [Wed Feb 17 04:25:37 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:39.841237 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-839cbcea-70ec-4da9-86f7-1103ba630226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:39.900940 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-839cbcea-70ec-4da9-86f7-1103ba630226 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.112954 Feb 17 04:25:39.902028 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 12/25] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:39 2021] POST /compute/v2.1/flavors => generated 366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:39.913730 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-227e302e-732f-40d6-923c-9234a0b75c06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:39.983515 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-227e302e-732f-40d6-923c-9234a0b75c06 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.074361 Feb 17 04:25:39.984147 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 14/26] 10.222.0.73 () {62 vars in 1233 bytes} [Wed Feb 17 04:25:39 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:39.994380 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-3605516f-a710-4030-b926-b79437494ecf admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:40.010247 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-3605516f-a710-4030-b926-b79437494ecf admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019827 Feb 17 04:25:40.010809 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 13/27] 10.222.0.73 () {58 vars in 1180 bytes} [Wed Feb 17 04:25:39 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:42.719464 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-19480b1d-fe75-4814-ba8f-94cb606c1cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:42.772009 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-19480b1d-fe75-4814-ba8f-94cb606c1cb6 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.107861 Feb 17 04:25:42.772730 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 15/28] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:42 2021] POST /compute/v2.1/flavors => generated 365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:42.783694 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-3693fc20-a124-42f1-ad87-c4a104e886ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:42.844044 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-3693fc20-a124-42f1-ad87-c4a104e886ae admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.064497 Feb 17 04:25:42.844666 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 14/29] 10.222.0.73 () {62 vars in 1233 bytes} [Wed Feb 17 04:25:42 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:42.854689 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d7fe1b04-7079-4ca0-96e7-94524460c5c0 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:42.872594 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d7fe1b04-7079-4ca0-96e7-94524460c5c0 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.021763 Feb 17 04:25:42.873169 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 16/30] 10.222.0.73 () {58 vars in 1180 bytes} [Wed Feb 17 04:25:42 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:45.476329 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-98beb704-a639-452d-8a03-5f269f1e2a58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:45.526290 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-98beb704-a639-452d-8a03-5f269f1e2a58 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.104305 Feb 17 04:25:45.526891 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 15/31] 10.222.0.73 () {62 vars in 1183 bytes} [Wed Feb 17 04:25:45 2021] POST /compute/v2.1/flavors => generated 368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:25:45.537891 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-5d66ee36-8765-4ae7-a862-3d4c3ab6d94e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:25:45.615378 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-5d66ee36-8765-4ae7-a862-3d4c3ab6d94e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.081508 Feb 17 04:25:45.616001 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 17/32] 10.222.0.73 () {62 vars in 1233 bytes} [Wed Feb 17 04:25:45 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:25:45.625892 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-a26b37cb-4396-4c2d-925d-2d712c56ad19 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:25:45.641663 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-a26b37cb-4396-4c2d-925d-2d712c56ad19 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019676 Feb 17 04:25:45.642231 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 16/33] 10.222.0.73 () {58 vars in 1180 bytes} [Wed Feb 17 04:25:45 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:27:01.509026 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-74acb06e-ca5e-486a-a6f0-2c912a4cd5a9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:01.537069 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-74acb06e-ca5e-486a-a6f0-2c912a4cd5a9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.084852 Feb 17 04:27:01.537849 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 18/34] 10.222.0.73 () {58 vars in 1150 bytes} [Wed Feb 17 04:27:01 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:27:03.230268 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-a26b37cb-4396-4c2d-925d-2d712c56ad19 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:03.231378 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-a26b37cb-4396-4c2d-925d-2d712c56ad19 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Feb 17 04:27:03.231828 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 17/35] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:03.416652 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-ad3b480e-f2cf-4591-a392-92d15d97e8b9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:03.431516 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.wsgi [None req-ad3b480e-f2cf-4591-a392-92d15d97e8b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 04:27:03.432083 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-ad3b480e-f2cf-4591-a392-92d15d97e8b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:27:03.432968 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-ad3b480e-f2cf-4591-a392-92d15d97e8b9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.071864 Feb 17 04:27:03.433570 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 19/36] 10.222.0.73 () {60 vars in 1181 bytes} [Wed Feb 17 04:27:03 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:27:03.445525 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-f0c57a8f-d947-4d0f-8bb9-b35f6ccdaff2 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:03.468115 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-f0c57a8f-d947-4d0f-8bb9-b35f6ccdaff2 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026376 Feb 17 04:27:03.468712 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1201 bytes} [Wed Feb 17 04:27:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:03.480468 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-18733511-d350-462e-8724-4374ffc90475 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:03.504800 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-18733511-d350-462e-8724-4374ffc90475 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028812 Feb 17 04:27:03.505382 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 20/38] 10.222.0.73 () {60 vars in 1201 bytes} [Wed Feb 17 04:27:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:03.515871 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-fdfcb9c6-c57e-4af9-8582-4b452cc0ce98 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:03.530672 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.wsgi [None req-fdfcb9c6-c57e-4af9-8582-4b452cc0ce98 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 04:27:03.531347 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-fdfcb9c6-c57e-4af9-8582-4b452cc0ce98 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:27:03.532202 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-fdfcb9c6-c57e-4af9-8582-4b452cc0ce98 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.020211 Feb 17 04:27:03.532747 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1181 bytes} [Wed Feb 17 04:27:03 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:27:05.109421 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-18733511-d350-462e-8724-4374ffc90475 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:05.110507 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-18733511-d350-462e-8724-4374ffc90475 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Feb 17 04:27:05.110954 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 21/40] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:05.294733 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-3347b634-2488-4967-a91e-631d0d58beab admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:05.310995 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.wsgi [None req-3347b634-2488-4967-a91e-631d0d58beab admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 04:27:05.311614 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-3347b634-2488-4967-a91e-631d0d58beab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:27:05.312526 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-3347b634-2488-4967-a91e-631d0d58beab admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.072682 Feb 17 04:27:05.313106 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1181 bytes} [Wed Feb 17 04:27:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:27:05.324043 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-ed734d1e-bf87-42eb-8230-ef1b1e947b7b admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:05.345851 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-ed734d1e-bf87-42eb-8230-ef1b1e947b7b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025553 Feb 17 04:27:05.346471 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1201 bytes} [Wed Feb 17 04:27:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:05.357220 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-e047907b-0872-4dfc-9f89-6254cde5e677 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:05.379960 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-e047907b-0872-4dfc-9f89-6254cde5e677 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026579 Feb 17 04:27:05.380642 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 21/43] 10.222.0.73 () {60 vars in 1201 bytes} [Wed Feb 17 04:27:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:05.391251 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-905fc6f9-4f12-4c55-9d3a-f71a809dc154 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:05.404492 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.wsgi [None req-905fc6f9-4f12-4c55-9d3a-f71a809dc154 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 04:27:05.405121 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-905fc6f9-4f12-4c55-9d3a-f71a809dc154 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:27:05.405975 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-905fc6f9-4f12-4c55-9d3a-f71a809dc154 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.018727 Feb 17 04:27:05.406552 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1181 bytes} [Wed Feb 17 04:27:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:27:06.974800 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-e047907b-0872-4dfc-9f89-6254cde5e677 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:06.975897 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-e047907b-0872-4dfc-9f89-6254cde5e677 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Feb 17 04:27:06.976330 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 22/45] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:07.163638 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-382185bf-3d21-4036-8353-addc755efb0b admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:07.184802 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.wsgi [None req-382185bf-3d21-4036-8353-addc755efb0b admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 04:27:07.185446 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-382185bf-3d21-4036-8353-addc755efb0b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:27:07.186312 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-382185bf-3d21-4036-8353-addc755efb0b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.081825 Feb 17 04:27:07.186906 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1184 bytes} [Wed Feb 17 04:27:07 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:27:07.197325 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-5460d2a8-95ac-4308-9ebe-38d8414768d2 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:07.219508 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-5460d2a8-95ac-4308-9ebe-38d8414768d2 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025942 Feb 17 04:27:07.220159 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1201 bytes} [Wed Feb 17 04:27:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:07.231692 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:07.254520 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026962 Feb 17 04:27:07.255131 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 25/48] 10.222.0.73 () {60 vars in 1201 bytes} [Wed Feb 17 04:27:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:07.265748 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-0ce9b732-d289-49ea-a352-31cb7cd8da29 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:07.278816 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.wsgi [None req-0ce9b732-d289-49ea-a352-31cb7cd8da29 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 04:27:07.279517 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-0ce9b732-d289-49ea-a352-31cb7cd8da29 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:27:07.280381 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-0ce9b732-d289-49ea-a352-31cb7cd8da29 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.018570 Feb 17 04:27:07.280961 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1184 bytes} [Wed Feb 17 04:27:07 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:27:08.868876 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:08.869990 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002400 Feb 17 04:27:08.870425 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 26/50] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:09.064673 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-a4137ee2-6552-4660-9239-5c05bb0019a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:27:09.117538 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-a4137ee2-6552-4660-9239-5c05bb0019a1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.118834 Feb 17 04:27:09.118148 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 25/51] 10.222.0.73 () {64 vars in 1226 bytes} [Wed Feb 17 04:27:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:27:10.701421 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:10.702498 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Feb 17 04:27:10.702917 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 27/52] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:10.888335 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d63a4aa8-b5bd-4674-ab19-f6fdca5df197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:27:10.957990 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d63a4aa8-b5bd-4674-ab19-f6fdca5df197 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.126371 Feb 17 04:27:10.958639 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 26/53] 10.222.0.73 () {64 vars in 1226 bytes} [Wed Feb 17 04:27:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:27:12.528732 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:12.529799 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Feb 17 04:27:12.530241 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 28/54] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:12.712458 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-43c93e13-c3d5-4f98-be7c-329a7d4f486a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:27:12.794180 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-43c93e13-c3d5-4f98-be7c-329a7d4f486a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.136600 Feb 17 04:27:12.794706 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 27/55] 10.222.0.73 () {64 vars in 1226 bytes} [Wed Feb 17 04:27:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:27:14.373120 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:14.374200 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Feb 17 04:27:14.374635 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 29/56] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:14.557364 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-ebe453b2-53af-469e-a231-a3df7e78b94f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:27:14.606901 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-ebe453b2-53af-469e-a231-a3df7e78b94f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.104466 Feb 17 04:27:14.607439 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 28/57] 10.222.0.73 () {64 vars in 1226 bytes} [Wed Feb 17 04:27:14 2021] POST /compute/v2.1/flavors => generated 409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:27:16.195342 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:16.196476 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Feb 17 04:27:16.196975 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 30/58] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:27:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:16.382043 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-42b9fb08-282c-42e0-9441-8afefd8667b7 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:16.413216 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-42b9fb08-282c-42e0-9441-8afefd8667b7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.088092 Feb 17 04:27:16.413750 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 29/59] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Feb 17 04:27:16 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:28:07.030052 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:07.031107 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-37a093d9-789d-4530-8525-a029ad6b44e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Feb 17 04:28:07.031585 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 31/60] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:28:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:07.216268 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:07.244175 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.082895 Feb 17 04:28:07.244862 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 30/61] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Feb 17 04:28:07 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:29:53.246451 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-42031962-a00f-47de-b7b3-41b00dd9f99e tempest-verify_tempest_config-39827532 tempest-verify_tempest_config-39827532-project] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:53.249143 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-42031962-a00f-47de-b7b3-41b00dd9f99e tempest-verify_tempest_config-39827532 tempest-verify_tempest_config-39827532-project] 10.222.0.73 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.182737 Feb 17 04:29:53.249881 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 32/62] 10.222.0.73 () {58 vars in 1124 bytes} [Wed Feb 17 04:29:53 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:28.103342 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:28.105269 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002756 Feb 17 04:31:28.106103 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 31/63] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:31:28 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:28.386699 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-68715e69-42b8-491c-accc-ca788ab3ad28 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:28.388612 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:28.388612 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:31:28.390385 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-68715e69-42b8-491c-accc-ca788ab3ad28 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.390929 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-68715e69-42b8-491c-accc-ca788ab3ad28 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.391890 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-68715e69-42b8-491c-accc-ca788ab3ad28 admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.392409 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-68715e69-42b8-491c-accc-ca788ab3ad28 admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.427096 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-68715e69-42b8-491c-accc-ca788ab3ad28 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.181879 Feb 17 04:31:28.427770 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1184 bytes} [Wed Feb 17 04:31:28 2021] GET /compute/v2.1/os-services => generated 791 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:30.255379 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:30.256591 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001912 Feb 17 04:31:30.257070 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 32/65] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:31:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:30.507591 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-0484f5bb-6640-4a53-9e42-145dff5d35c6 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:30.510171 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:30.510171 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:31:30.513872 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-0484f5bb-6640-4a53-9e42-145dff5d35c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.514771 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-0484f5bb-6640-4a53-9e42-145dff5d35c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.516408 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-0484f5bb-6640-4a53-9e42-145dff5d35c6 admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.517305 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-0484f5bb-6640-4a53-9e42-145dff5d35c6 admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.561823 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-0484f5bb-6640-4a53-9e42-145dff5d35c6 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.146161 Feb 17 04:31:30.562489 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1184 bytes} [Wed Feb 17 04:31:30 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:31:42.686339 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:42.687486 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Feb 17 04:31:42.689374 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 33/67] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:31:42 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:31:42.881982 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-88d2a0ab-b911-44fd-9a6a-c625111912f8 admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:42.884258 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:42.884258 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:31:42.887068 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-88d2a0ab-b911-44fd-9a6a-c625111912f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:42.887931 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-88d2a0ab-b911-44fd-9a6a-c625111912f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:42.889344 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-88d2a0ab-b911-44fd-9a6a-c625111912f8 admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:42.890126 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-88d2a0ab-b911-44fd-9a6a-c625111912f8 admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:42.939773 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-88d2a0ab-b911-44fd-9a6a-c625111912f8 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.120047 Feb 17 04:31:42.940832 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1184 bytes} [Wed Feb 17 04:31:42 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:31:44.576680 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] Calling method '>' {{(pid=83354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:44.577758 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-d611f6c2-4ce2-44fe-af5e-52305f7a22c0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Feb 17 04:31:44.578195 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83354|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1065 bytes} [Wed Feb 17 04:31:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:44.767195 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG nova.api.openstack.wsgi [None req-90b6995c-eeae-446a-93f7-da62fe6279fd admin admin] Calling method '>' {{(pid=83355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:44.768512 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:44.768512 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: warnings.warn(msg) Feb 17 04:31:44.770257 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-90b6995c-eeae-446a-93f7-da62fe6279fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:44.770743 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-90b6995c-eeae-446a-93f7-da62fe6279fd admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:44.771612 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-90b6995c-eeae-446a-93f7-da62fe6279fd admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:44.772081 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: DEBUG oslo_concurrency.lockutils [None req-90b6995c-eeae-446a-93f7-da62fe6279fd admin admin] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:44.799919 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: INFO nova.api.openstack.requestlog [None req-90b6995c-eeae-446a-93f7-da62fe6279fd admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.090405 Feb 17 04:31:44.800436 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: [pid: 83355|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1184 bytes} [Wed Feb 17 04:31:44 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:32:43.382131 dv-cinder-759955-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 17 04:32:43.383982 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: Wed Feb 17 04:32:43 2021 - graceful shutdown triggered... Feb 17 04:32:43.384510 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: Gracefully killing worker 1 (pid: 83354)... Feb 17 04:32:43.384610 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: Gracefully killing worker 2 (pid: 83355)... Feb 17 04:32:44.385152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: worker 1 buried after 1 seconds Feb 17 04:32:44.385152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: worker 2 buried after 1 seconds Feb 17 04:32:44.385152 dv-cinder-759955-5-iscsi devstack@n-api.service[83353]: goodbye to uWSGI. Feb 17 04:32:44.386970 dv-cinder-759955-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 17 04:32:44.388873 dv-cinder-759955-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 04:32:44.396976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 04:32:44 2021] *** Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: nodename: dv-cinder-759955-5-iscsi Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: machine: x86_64 Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: clock source: unix Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: pcre jit disabled Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: detected number of CPU cores: 4 Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: current working directory: / Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: detected binary path: /usr/bin/uwsgi-core Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: dropping root privileges as early as possible Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: your processes number limit is 47843 Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: your memory page size is 4096 bytes Feb 17 04:32:44.399615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: detected max file descriptor number: 2048 Feb 17 04:32:44.400767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: lock engine: pthread robust mutexes Feb 17 04:32:44.400767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: thunder lock: enabled Feb 17 04:32:44.400767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 04:32:44.400767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: dropping root privileges after socket binding Feb 17 04:32:44.400767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 04:32:44.447046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Python main interpreter initialized at 0x56303b2909c0 Feb 17 04:32:44.447046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: dropping root privileges after plugin initialization Feb 17 04:32:44.447046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: python threads support enabled Feb 17 04:32:44.447046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: your server socket listen backlog is limited to 100 connections Feb 17 04:32:44.447046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: your mercy for graceful operations on workers is 90 seconds Feb 17 04:32:44.447735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 04:32:44.447735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: *** Operational MODE: preforking *** Feb 17 04:32:44.447924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: dropping root privileges after application loading Feb 17 04:32:44.447924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: *** uWSGI is running in multiple interpreter mode *** Feb 17 04:32:44.447924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: spawned uWSGI master process (pid: 98220) Feb 17 04:32:44.448018 dv-cinder-759955-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 04:32:44.448418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: spawned uWSGI worker 1 (pid: 98221, cores: 1) Feb 17 04:32:44.448644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: spawned uWSGI worker 2 (pid: 98222, cores: 1) Feb 17 04:32:44.448783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 04:32:49.133920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:32:49.134461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:32:49.135835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:32:49.136279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:32:49.136578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:32:49.137049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.137422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.137792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.138163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.138551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.138904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.139274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.139668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.140050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.140353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.140717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.141094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759955-5-iscsi {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.141470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.141835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.142192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.142564 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.142917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.143303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.143666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.144289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.144641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.145000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.145361 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.145752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.146118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.146479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.146853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.147211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.147618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.147976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.148355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759955-5-iscsi {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.149319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.149693 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.150055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.150561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.150920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.151355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.158314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.159844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.160879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.161168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.161538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.161910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.162289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.162641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.163010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.163506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.163799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.164153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.164583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.164960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.165316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.165763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.166139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.166494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.166850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.167205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.167611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.167992 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.168342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.168635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.168985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.169338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.169714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.170064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.170414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.170767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.171113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.171492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.171851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.172209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.172562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.172918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.173269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.173619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.173972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.174593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.174965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.175403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.175761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.176114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.176468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.176822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.177193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.177546 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.177899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.178272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.178624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.178976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.179368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.181772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.182059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.182411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.182759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.183111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.183487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.183839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.184186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.184543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.184905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.185276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.185634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.185984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.186335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.186708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.187097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.187511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.187916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.188280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.188669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.189055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.189418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.189777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.190139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.190519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.190876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.191234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.191618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.191999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.192362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.192748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.193138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.193456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.193821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.194177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.194539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.194919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.195304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.196191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.196611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.197010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.197375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.197750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.198110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.198489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.198870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.199235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.199606 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.199996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.200309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.200665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.201054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.201420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.201782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.202136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.202495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.203051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.203174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.203532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.203900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.204281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.204637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.205028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.205380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.205737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.206095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.206447 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.206804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.207265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.207639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.207754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:32:49.207958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:32:49.208080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.208349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.208696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.209067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.209418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.209529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:32:49.209769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.209920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:32:49.210131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.210241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:32:49.210487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.210648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.210841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.211020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.211224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.211972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.212153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.212313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.212462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.212686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.212834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.213037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.213201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.213410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.213525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.213764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.213884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.214138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.214255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.214436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.214539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.214795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.214911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.215150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759955-5-iscsi {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.215266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.215545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.215660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.215894 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.215996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.216243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.216381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.216589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.216710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.216932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.217090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.217270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.217376 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.217594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.217710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.217949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.218203 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.218485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.218650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.218817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.218976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.219124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.219303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.219457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.219622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.219779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.219941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.220091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.220246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.220421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.220578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.220734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.220885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.221033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.221238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.221389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.221590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.221742 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.221958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759955-5-iscsi {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.222109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.222321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.222489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.222674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.222823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.223021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.223189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.223398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.223561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.223717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.223963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.224118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.224287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.224441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.224588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.224754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.224914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.225071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.225306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.225470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.225618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.225769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.225927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.226088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.226268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.226418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.226578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.226697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.226887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.227133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.227256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.227504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.227609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.227866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.227995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.228224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.228337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.228552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.228667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.228828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.228939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.229179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.229291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.229547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.229651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.229896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.230008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.230253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.230365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.230534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.230639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.230824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.230935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.231193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.231350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.231598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.231702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.231942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.232059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.232285 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.232388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.232635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.232747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.232984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.233089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.233323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.233433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.233672 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.233780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.234026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.234167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.234365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.234485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.234734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.234909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.235078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.235229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.235481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.235655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.235812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.235986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.236152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.236303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.236453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.236604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.236766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.236959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.237117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.237376 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.237543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.237707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.237904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.238082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.238234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.238384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.238535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.238660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.238775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.238882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.239071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.239236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.239470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.239708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.239885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.240048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.240217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.240382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.240533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.240667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.240836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.241004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.241154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.241317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.241468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.241618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.241791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.241950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.242120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.242276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.242446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.242600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.242775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.242939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.243101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.243251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.243458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.243628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.243778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.243941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.244139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.244295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.244514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.244627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.244899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.245008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.245235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.245350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.245587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.245745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.245936 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.246107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.246273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.246434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.246585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.246752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.246958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.247124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.247313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.247477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.247650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.247801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.247970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.248128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.248309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.248466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.248643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.248795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.248958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.249132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.249305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.249455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.249623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.249784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.249934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.250096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.250257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.250368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.250573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.250814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.250973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.251124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.251273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.251437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.251605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.251768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.251919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.252081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.252232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.252402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.252553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.252716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.252875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.253038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.253200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.253357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.253520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.253685 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.253847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.253952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.254144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.254256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.254489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.254592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.254830 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.254946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.255171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.255317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.255540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.255654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.255910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.256024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.256274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.256379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.256621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.256729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.256966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.257056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.257383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.257485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.257673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.257790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:32:49.257982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.258596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.258851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.258955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.259210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.259571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.260016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.260016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.260263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.260353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.260634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.260634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.261054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.261197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.261296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.261570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.262154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.262279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.262410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.262570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.262683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.262790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.263008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.263181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.263393 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.263515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.263750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.263861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.264105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.264208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.264457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.264569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.264810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.264913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.265162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.265311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.265518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.265633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.265887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.266019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.266213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.266342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.266564 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.266669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.266914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.267016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.267259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.267393 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.267653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.267764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.268022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.268135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.268370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.268480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.268717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.268871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.269045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.269266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.269367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.269481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.269716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.269822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.270130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.270291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.270403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.270520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.270752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.270890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.271100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.271215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.271469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.271594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.271820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.271930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.272180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.272283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.272528 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.272623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.272870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.272980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.273212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.273320 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.273549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.273680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.274635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.274756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.274856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.274954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.275236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.275465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.275616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.275719 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.275964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.276052 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.276323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.276427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.276677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.276789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.277019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.277122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.277364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.277474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.277712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.277815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.278065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.278175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.278410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.278520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.278751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.278853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.279118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.279230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.279498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.279594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.279836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.279945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.280209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.280299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.280537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.280649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.280881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.280984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.281241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.281356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.281590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.281711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.281933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.282044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.282280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.282391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.282639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.282727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.282986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.283095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.283357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.283476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.283716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.283810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.284076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.284186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.284420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.284533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.284767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.284876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.285123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.285231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.285477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.285580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.285824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.285933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.286168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.286256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.286522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.286626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.286869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.286978 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.287206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.287323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.287582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.287686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.287922 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.288023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.288271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.288384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.288612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.288715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.288950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.289119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.289356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.289504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.289665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.289862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.290016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.290213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.290363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.290571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.290684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.290929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.291014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.291337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.291434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.291649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.291751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.291990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.292078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.292421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.292511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.292790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.292880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.293139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.293223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.293483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.293574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.293828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.293913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.294165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.294248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.294512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.294602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.294879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.294962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.295223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.295341 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.295603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.295704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.295955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.296041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.296330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.296421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.296683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.296774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.297056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.297140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.297402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.297547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.297759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.297908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.298130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.298261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.298485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.298746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.298836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.299394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.299628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.299753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.299837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.300102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.300200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.300545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.300682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.300835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.300955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.301189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.301328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.302135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.302296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.302443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.302582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.302722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.302877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.303930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.304066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.304208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.304344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.304489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.304627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.304770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.305414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.305553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.305690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.305834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.305970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.306112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.306303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.306446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.306660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.306818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.307007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.307174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.307385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.307544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.307734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.307893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.308078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.308227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.308439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.308595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.308781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.308935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.309129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.309281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.309487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.309641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.309836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.309977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.310190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.310332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.310542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.310683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.310985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.311110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.311228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.311390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.311628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.311777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.311934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.312071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.312223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.312368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.312574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.312723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.312928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.313048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.313281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.313391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.313652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.313767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.313996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.314103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.314347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.314460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.314697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.314812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.315036 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.315151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.315414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.315525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.315762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.315885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.316165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.316478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.316584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.316857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.316970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.317447 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.317554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.317631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.317711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.317868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.317974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.318226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.318330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.318608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.318732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.318967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.319083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.319331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.319441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.319689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.319775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.320046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.320166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.320398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.320503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.321498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.321760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.321760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.322987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.323956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.324097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.324249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.324402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.324595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.324737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.324941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.325095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.325295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.325446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.325634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.325778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.325977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.326121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.326330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.326482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.326675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.326817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.327028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.327171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.327390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.327547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.327772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.327913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.328114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.328256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.328464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.328623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.328843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.328994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.329217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.329368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.329559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.329714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.330854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.331003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.331213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.331384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.331766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.331897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.332915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.333199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.333357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.333550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.333704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.333898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.334040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.334259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.334498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.334646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.334797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.334937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.335082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.335219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.335395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.335615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.335769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.335964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.336105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.336339 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.336484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.336691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.336837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.337044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.337193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.337392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.337535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.337745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.337899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.338091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.338244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.338437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.338579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.338789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.338941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.339156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.339370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.339519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.339661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.339885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.340037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.340229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.340382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.340578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.340739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.340927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.341078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.341276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.341429 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.341944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342203 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.342983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.343125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.343263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.343448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.343596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.343809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.343951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.344934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.345069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.345214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.345352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.345567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.345713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.345985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.346126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.346333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.346477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.346696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.346848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.347066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.347326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.347472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.347698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.347841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.348082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.348235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.348460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.348612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.348806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.348945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.349174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.349315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.349543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.349687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.350878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.351020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.351235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.351416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.351615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.351866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.352194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.352364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.352547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.352705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.352846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.352994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.353134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.353283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.353419 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.353559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.353700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.353924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.354068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.354270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.354410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.354624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.354773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.354978 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.355126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.355352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.355510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.355708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.355946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.356099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.356236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.356373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.356524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.356706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.356855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.357078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.357220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.357421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.357578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.357767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.357906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.358110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.358250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.358448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.358601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.358799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.358952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.359137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.359386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.359531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.359685 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.359821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.360984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.361130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.361274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.361472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.361615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.361828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.361980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.362383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.362601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.362758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.362896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363488 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.363908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.364095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.364233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.364378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.364524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.364668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.364805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.365010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.365161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.365358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.365499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.365706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.365847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.366051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.366204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.366421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.366575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.366762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.366910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.367117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.367258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.368030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.368185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.368408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.368548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.368771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.368915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.369128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.369270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.369533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.369696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.369878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.370077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.370218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.370515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.370658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.370904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.371053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.371226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.371491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.371657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.371814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.371980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.372114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.372390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.372572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.372689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.372802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.373003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.373107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.373365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.373469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.373718 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.373828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.374075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.374189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.374437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.374545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.374789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.374903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.375138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.375248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.375524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.375630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.375882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.375991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.376237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.376348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.376593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.376696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.376950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.377053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.377323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.377437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.377679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.377782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.378032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.378150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.378382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.378486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.378732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.378834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.379081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.379182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.379451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.379556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.379803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.379906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.380141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.380253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.380476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.380588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.380826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.380930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.381176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.381286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.381517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.381627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.381867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.382011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.382238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.382352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.382567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.382706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.382968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.383173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.383386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.383506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.383741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.383844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.384112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.384259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.384468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.384580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.384816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.384925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.385164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.385273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.385511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.385622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.385878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.385981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.386225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.386328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.386590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.386700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.386968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.387071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.387359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.387479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.387717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.387827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.388092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.388197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.388454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.388574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.388807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.388910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.389158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.389261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.389514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.389616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.389856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.389966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.390175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.390288 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.390527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.390631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.390876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.390987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.391224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.391354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.391593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.391705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.391947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.392049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.392296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.392420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.392620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.392794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.392966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.393125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.393314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.393419 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.393655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.393766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.394023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.394127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.394377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.394480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.394724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.394835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.395071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.395181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.395443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.395586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.395795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.395899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.396170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.396280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.396543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.396653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.396905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.397010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.397261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.397364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.397640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.397745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.397990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.398094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.398346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.398459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.399236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.399534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.399650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.399897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.400000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.400257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.400360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.400615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.400744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.400952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.401073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.401312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.401415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.401657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.401841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.402007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.402117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.402367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.402482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.402750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.402884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.403093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.403392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.403509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.403749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.403860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.404134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.404238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.404495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.404604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.404842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.404946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.405189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.405291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.405544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.405646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.405893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.406004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.406248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.406357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.406602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.406705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.406959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.407063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.407329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.407437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.407714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.407827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.408065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.408174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.408442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.408544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.408818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.408991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.409075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98222) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:32:49.409174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.409502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.409861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.410228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.410650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.411011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.411390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.411757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.412120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.412487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.412850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.413271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.413550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.413912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.414289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.415211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.415598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.415958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.416338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.416727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.417089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.417448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.417809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.418168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.418761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.419117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.419524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.419897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.420267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.420628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.420988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.421342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.421689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.422037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.422422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.422742 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.423091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.423475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.423826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.424438 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.424799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.425154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.425769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.426168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.426526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.426899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.427292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.427680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.428032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.428404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.428759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.429111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.429493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.429866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.430240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.430590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.430942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.431321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.432796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.432796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.432796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.432796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.433385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.433385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.433793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.433974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.434318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.434666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.435012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.435382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.435741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.436088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.436442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.436791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.437139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.437489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.437841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.438185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.438559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.438906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.439332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.439639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.439990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.440360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.440716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.441070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.441468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.441826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.442461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.442852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.443219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.443649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.444038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.444423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.444778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.445129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.445500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.445878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.445977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98222) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.446235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.446589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.446941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.447313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.447677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.448033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.448387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.448740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.449092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.449492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.449849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.450209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.450577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.450930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.451305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.451755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.452115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.452473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.452833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.453214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.453574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.453921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.454407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.454764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.455125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.455518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.455870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.456249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.456637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.457031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.457404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.457758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.458104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.458453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.458807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.459200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.459618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.459979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.461809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.461809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.461809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.462091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.462252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.462608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.462965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.463366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.463738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.464104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.464460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.464830 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.465182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.465546 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.465896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.466254 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.466608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.466968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.467375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.467739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.468116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.468471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.468842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.469196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.469565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.469937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.470299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.470651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.471033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.471415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.471771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.472397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.472758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.473117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.473473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.473854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.474230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.474583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.474958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.475339 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.475708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.476068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.476421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.476820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.477734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.478092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.478450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.478805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.479164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.479551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.479928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.480301 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.480675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.481049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.481446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.481803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.482196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.482576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:32:49.482859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:32:49.518033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.721518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.context [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed6ce518-2f7d-44db-9afc-ecf963cec3c5(cell1) {{(pid=98222) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:32:49.728906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.732686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.734250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.738287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.785370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98222) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.787417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98222) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.790332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.context [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed6ce518-2f7d-44db-9afc-ecf963cec3c5(cell1) {{(pid=98221) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:32:49.796183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.798115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.799422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.801720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.832601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.846229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.851623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98222) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.883105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:32:49.951722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:32:49.951722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: from cryptography.utils import int_from_bytes Feb 17 04:32:49.952721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:32:49.952721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: from cryptography.utils import int_from_bytes Feb 17 04:32:49.985474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:32:49.985474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: from cryptography.utils import int_from_bytes Feb 17 04:32:49.985883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:32:49.985883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: from cryptography.utils import int_from_bytes Feb 17 04:32:50.038772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading Gnome Feb 17 04:32:50.071778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading Google Feb 17 04:32:50.076577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading Gnome Feb 17 04:32:50.078537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading Windows (alt) Feb 17 04:32:50.086824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading file Feb 17 04:32:50.088011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading keyczar Feb 17 04:32:50.088472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading multi Feb 17 04:32:50.089494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Loading pyfs Feb 17 04:32:50.098895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading Google Feb 17 04:32:50.103495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading Windows (alt) Feb 17 04:32:50.108625 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading file Feb 17 04:32:50.110148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading keyczar Feb 17 04:32:50.110939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading multi Feb 17 04:32:50.112632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO keyring.backend [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Loading pyfs Feb 17 04:32:50.484695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:32:50.493825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:32:50.538327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:32:50.546891 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:32:50.738744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:32:50.745006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-8fd9c087-7751-42e8-af99-c74f60113003 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:32:50.750680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56303b2909c0 pid: 98222 (default app) Feb 17 04:32:50.824912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:32:50.831190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WARNING keystonemiddleware.auth_token [None req-a6fd626b-2758-4399-aa4c-558e177997f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:32:50.837557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56303b2909c0 pid: 98221 (default app) Feb 17 04:33:32.926159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-412f034e-4211-4f58-86b1-4a058018baa5 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Action: 'create', calling method: .version_select at 0x7f9b3dcd42f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1736518100"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:35.668090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-412f034e-4211-4f58-86b1-4a058018baa5 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.171963 Feb 17 04:33:35.668090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1145 bytes} [Wed Feb 17 04:33:31 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 4175 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 04:33:36.088014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f127bd16-0bdc-4783-9856-3b8663c61a9a tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3de11e18>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:36.870479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f127bd16-0bdc-4783-9856-3b8663c61a9a tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142" status: 200 len: 346 microversion: 2.1 time: 1.199056 Feb 17 04:33:36.878097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 1/2] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:33:35 2021] GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142 => generated 346 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:33:36.884654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a57aeb03-def3-4da7-b4d0-fbb8795b8e43 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Action: 'create', calling method: .version_select at 0x7f9b3dcd4ae8>, body: {"snapshot": {"volume_id": "76a0cb23-92d2-4254-a814-b99da90dd142", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1861248737"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:37.804995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a57aeb03-def3-4da7-b4d0-fbb8795b8e43 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.924903 Feb 17 04:33:37.827938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1152 bytes} [Wed Feb 17 04:33:36 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:33:37.835021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f8cb5c23-df6e-4986-94d0-f111fce7abc5 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dbd9378>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:38.071692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f8cb5c23-df6e-4986-94d0-f111fce7abc5 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 200 len: 287 microversion: 2.1 time: 0.256802 Feb 17 04:33:38.073180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:37 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:38.087529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7a7108ed-61fb-460e-9665-115c6fdfa1df tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dc9dd90>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:38.332147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7a7108ed-61fb-460e-9665-115c6fdfa1df tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.251098 Feb 17 04:33:38.333050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 3/5] 10.222.0.73 () {58 vars in 1130 bytes} [Wed Feb 17 04:33:38 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:38.344494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cb14b7cf-3490-4dfc-978c-c57ceeeb1059 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dbd9400>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:38.539607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cb14b7cf-3490-4dfc-978c-c57ceeeb1059 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 200 len: 287 microversion: 2.1 time: 0.198561 Feb 17 04:33:38.539970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:38 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 287 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:39.556617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d6d6ed08-cffb-441f-83d7-616dd0792fba tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dcaf7b8>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:39.627076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d6d6ed08-cffb-441f-83d7-616dd0792fba tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 200 len: 287 microversion: 2.1 time: 0.076259 Feb 17 04:33:39.627747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:39 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:40.644816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7818b109-01b8-4a99-8ad4-5938215da709 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dce6d90>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:40.866298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7818b109-01b8-4a99-8ad4-5938215da709 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 200 len: 287 microversion: 2.1 time: 0.228617 Feb 17 04:33:40.867060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:40 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 287 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:33:41.670002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1866476591", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "a7fab7cd-0027-4e4e-a2a9-d71ce7a48bfd"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:41.910452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-116d9b65-9dec-4180-96b8-8e032b7ac141 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dce6f28>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:41.989472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] validate_networks() for [('a7fab7cd-0027-4e4e-a2a9-d71ce7a48bfd', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:33:42.099587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-116d9b65-9dec-4180-96b8-8e032b7ac141 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 200 len: 288 microversion: 2.1 time: 0.221628 Feb 17 04:33:42.101165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 5/9] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:41 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 288 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:42.135561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d0991340-249f-4fc5-bd28-6defe1f6a227 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dcb5488>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:42.505023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d0991340-249f-4fc5-bd28-6defe1f6a227 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 202 len: 0 microversion: 2.1 time: 0.391459 Feb 17 04:33:42.506013 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 6/10] 10.222.0.73 () {58 vars in 1244 bytes} [Wed Feb 17 04:33:42 2021] DELETE /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:33:42.527130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cff34335-a085-46c0-8d12-16de48c5e6aa tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dce6e18>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:42.651580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cff34335-a085-46c0-8d12-16de48c5e6aa tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 200 len: 287 microversion: 2.1 time: 0.138242 Feb 17 04:33:42.653120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 7/11] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:42 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:43.672136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c24259fb-96c2-48ae-a6da-9f58dd31fb7b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dce6b70>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:43.804314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-c24259fb-96c2-48ae-a6da-9f58dd31fb7b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] HTTP exception thrown: Snapshot 025bba80-53d0-4a78-b78d-b89e5406328a could not be found. Feb 17 04:33:43.805998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c24259fb-96c2-48ae-a6da-9f58dd31fb7b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Returning 404 to user: Snapshot 025bba80-53d0-4a78-b78d-b89e5406328a could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:43.807754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c24259fb-96c2-48ae-a6da-9f58dd31fb7b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a" status: 404 len: 111 microversion: 2.1 time: 0.142507 Feb 17 04:33:43.810834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 8/12] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:33:43 2021] GET /compute/v2.1/os-snapshots/025bba80-53d0-4a78-b78d-b89e5406328a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:43.838799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2f172c3a-16fb-437a-908f-2f2b7cf255c6 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b418b6d08>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:44.411510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2f172c3a-16fb-437a-908f-2f2b7cf255c6 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142" status: 202 len: 0 microversion: 2.1 time: 0.593495 Feb 17 04:33:44.414305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 9/13] 10.222.0.73 () {58 vars in 1238 bytes} [Wed Feb 17 04:33:43 2021] DELETE /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:33:44.439947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-96d7e5f7-61d4-4d5d-b05c-b4300d052fe3 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dce6d90>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:44.735902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-96d7e5f7-61d4-4d5d-b05c-b4300d052fe3 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142" status: 200 len: 345 microversion: 2.1 time: 0.316024 Feb 17 04:33:44.738430 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 10/14] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:33:44 2021] GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142 => generated 345 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:45.759656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3dea4805-1533-4500-be26-5f545f7c733b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b3dce6e18>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:46.097999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-3dea4805-1533-4500-be26-5f545f7c733b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] HTTP exception thrown: Volume 76a0cb23-92d2-4254-a814-b99da90dd142 could not be found. Feb 17 04:33:46.099269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3dea4805-1533-4500-be26-5f545f7c733b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Returning 404 to user: Volume 76a0cb23-92d2-4254-a814-b99da90dd142 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:46.103337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3dea4805-1533-4500-be26-5f545f7c733b tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142" status: 404 len: 109 microversion: 2.1 time: 0.351893 Feb 17 04:33:46.112644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 11/15] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:33:45 2021] GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142 => generated 109 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:46.158512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-777dd8a2-072d-442d-a8a9-ec5e4fea7da8 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b411e9488>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:46.377135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-777dd8a2-072d-442d-a8a9-ec5e4fea7da8 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] HTTP exception thrown: Volume 76a0cb23-92d2-4254-a814-b99da90dd142 could not be found. Feb 17 04:33:46.378676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-777dd8a2-072d-442d-a8a9-ec5e4fea7da8 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Returning 404 to user: Volume 76a0cb23-92d2-4254-a814-b99da90dd142 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:46.381074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-777dd8a2-072d-442d-a8a9-ec5e4fea7da8 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142" status: 404 len: 109 microversion: 2.1 time: 0.253983 Feb 17 04:33:46.383017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 12/16] 10.222.0.73 () {58 vars in 1238 bytes} [Wed Feb 17 04:33:46 2021] DELETE /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142 => generated 109 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:46.398082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-577bdd18-b4c2-459f-a898-3c70ca840644 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Calling method '.version_select at 0x7f9b418b6d08>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:46.541107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-577bdd18-b4c2-459f-a898-3c70ca840644 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] HTTP exception thrown: Volume 76a0cb23-92d2-4254-a814-b99da90dd142 could not be found. Feb 17 04:33:46.542222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-577bdd18-b4c2-459f-a898-3c70ca840644 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] Returning 404 to user: Volume 76a0cb23-92d2-4254-a814-b99da90dd142 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:46.544174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-577bdd18-b4c2-459f-a898-3c70ca840644 tempest-VolumesSnapshotsTestJSON-372200064 tempest-VolumesSnapshotsTestJSON-372200064-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142" status: 404 len: 109 microversion: 2.1 time: 0.154995 Feb 17 04:33:46.545839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 13/17] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:33:46 2021] GET /compute/v2.1/os-volumes/76a0cb23-92d2-4254-a814-b99da90dd142 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:46.614083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:33:46.614083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:33:46.614083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:33:46.614083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:33:46.614083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:33:46.654721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.659191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.660734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.662753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.708348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Getting quotas for project d8f6d6d4d16e4f8291cf32fca2f053ca. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:33:46.722215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Getting quotas for user b9908455ea1044d59213a7a60a7dac07 and project d8f6d6d4d16e4f8291cf32fca2f053ca. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:33:46.763189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:33:46.768973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:33:47.158017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5a106c42-5a91-4786-b818-f916d3c6aab3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.761687 Feb 17 04:33:47.159245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 5/18] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:33:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 5765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:33:47.174825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f62f80c7-bf3c-4b07-b24c-a05cf1e587f2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:47.176120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f62f80c7-bf3c-4b07-b24c-a05cf1e587f2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:47.357928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f62f80c7-bf3c-4b07-b24c-a05cf1e587f2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:47.388876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f62f80c7-bf3c-4b07-b24c-a05cf1e587f2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1215 microversion: 2.1 time: 0.209393 Feb 17 04:33:47.392236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 14/19] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:47 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:48.410885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f539a4da-4efe-45f3-9fd9-f58ec53ea4dd tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:48.416618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f539a4da-4efe-45f3-9fd9-f58ec53ea4dd tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:48.877531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f539a4da-4efe-45f3-9fd9-f58ec53ea4dd tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:48.944084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f539a4da-4efe-45f3-9fd9-f58ec53ea4dd tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1215 microversion: 2.1 time: 0.539112 Feb 17 04:33:48.952838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 6/20] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:48 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1215 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:49.981853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-34af93c6-54dc-4b0d-857c-194f98c061aa tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:49.982696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-34af93c6-54dc-4b0d-857c-194f98c061aa tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:50.513955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-34af93c6-54dc-4b0d-857c-194f98c061aa tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:50.526999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-34af93c6-54dc-4b0d-857c-194f98c061aa tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1215 microversion: 2.1 time: 0.550777 Feb 17 04:33:50.527636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 15/21] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:49 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1215 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:51.554080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:51.555864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:51.573171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.576594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.577782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.578634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.986551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:52.004262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cf321fae-0215-4711-b6dc-650d3e10ab7b tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1219 microversion: 2.1 time: 0.457361 Feb 17 04:33:52.018126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 7/22] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:51 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1219 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:53.029561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:53.030026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:53.041540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.042333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.043434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.053516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.633699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:53.650640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c20ca285-6c01-4207-b7e0-45af24306bf3 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1267 microversion: 2.1 time: 0.629319 Feb 17 04:33:53.664608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 16/23] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:53 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1267 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:54.679863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:54.680994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:54.727420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.728256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:54.729672 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.730485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:55.148974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:55.165185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fcf92ec2-ed88-4c9d-8a00-c71e4c683adf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1273 microversion: 2.1 time: 0.493344 Feb 17 04:33:55.166323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 8/24] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:54 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1273 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:56.185594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:56.186283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:56.202233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.210391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.211519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.212195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.619103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-da8e5872-1597-41ee-ad1a-7df2fe40ea04 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Action: 'create', calling method: .version_select at 0x7f9b3dce6620>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1628431677", "metadata": {"Type": "work"}}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:56.622142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-da8e5872-1597-41ee-ad1a-7df2fe40ea04 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:56.623183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-da8e5872-1597-41ee-ad1a-7df2fe40ea04 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.916551 Feb 17 04:33:56.636227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 17/25] 10.222.0.73 () {60 vars in 1146 bytes} [Wed Feb 17 04:33:55 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 930 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:33:56.645732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-83c3ca97-6762-4746-899a-b880bce8a2bb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Action: 'create', calling method: .version_select at 0x7f9b3db2cc80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1659366724", "metadata": {"Type": "work"}}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:56.647834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-83c3ca97-6762-4746-899a-b880bce8a2bb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:56.648895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-83c3ca97-6762-4746-899a-b880bce8a2bb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007162 Feb 17 04:33:56.649662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 18/26] 10.222.0.73 () {60 vars in 1146 bytes} [Wed Feb 17 04:33:56 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 17 04:33:56.664549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7e060c08-988e-4063-8da4-62d44fb661fd tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Action: 'create', calling method: .version_select at 0x7f9b3db2cc80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1050865597", "metadata": {"Type": "work"}}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:56.666040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7e060c08-988e-4063-8da4-62d44fb661fd tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:56.669836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7e060c08-988e-4063-8da4-62d44fb661fd tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014649 Feb 17 04:33:56.674973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 19/27] 10.222.0.73 () {60 vars in 1146 bytes} [Wed Feb 17 04:33:56 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:33:56.683234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-27a8d072-fe6e-4598-a896-81b810c149b6 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Calling method '.version_select at 0x7f9b3db9eea0>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:56.853101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-27a8d072-fe6e-4598-a896-81b810c149b6 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] HTTP exception thrown: Volume tempest-invalid-1250379865 could not be found. Feb 17 04:33:56.854228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-27a8d072-fe6e-4598-a896-81b810c149b6 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Returning 404 to user: Volume tempest-invalid-1250379865 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:56.855370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-27a8d072-fe6e-4598-a896-81b810c149b6 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1250379865" status: 404 len: 99 microversion: 2.1 time: 0.175978 Feb 17 04:33:56.856179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 20/28] 10.222.0.73 () {58 vars in 1208 bytes} [Wed Feb 17 04:33:56 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1250379865 => generated 99 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 17 04:33:56.869815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a249f5bb-2c60-417d-a587-aefbcd47ba1f tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005496 Feb 17 04:33:56.871056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 21/29] 10.222.0.73 () {58 vars in 1130 bytes} [Wed Feb 17 04:33:56 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 17 04:33:56.882547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fab43d97-a171-4b88-a296-dd02eb726e09 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003854 Feb 17 04:33:56.883557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 22/30] 10.222.0.73 () {58 vars in 1127 bytes} [Wed Feb 17 04:33:56 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 17 04:33:56.892801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-741dfcd8-40ac-40cc-a90a-8adb52fc25fb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Calling method '.version_select at 0x7f9b3db9eea0>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:57.060221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-741dfcd8-40ac-40cc-a90a-8adb52fc25fb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] HTTP exception thrown: Volume 9b83a425-bd00-4c9f-b191-079b14c77816 could not be found. Feb 17 04:33:57.061205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-741dfcd8-40ac-40cc-a90a-8adb52fc25fb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Returning 404 to user: Volume 9b83a425-bd00-4c9f-b191-079b14c77816 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:57.062318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-741dfcd8-40ac-40cc-a90a-8adb52fc25fb tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/9b83a425-bd00-4c9f-b191-079b14c77816" status: 404 len: 109 microversion: 2.1 time: 0.173315 Feb 17 04:33:57.063433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 23/31] 10.222.0.73 () {58 vars in 1238 bytes} [Wed Feb 17 04:33:56 2021] DELETE /compute/v2.1/os-volumes/9b83a425-bd00-4c9f-b191-079b14c77816 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:57.073504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-280242ad-14a4-431e-83c9-ca613a832ee2 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Calling method '.version_select at 0x7f9b3db2c158>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:57.217821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-280242ad-14a4-431e-83c9-ca613a832ee2 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] HTTP exception thrown: Volume 8bbc8d3b-adec-4fa1-8178-f71c4de1107f could not be found. Feb 17 04:33:57.219070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-280242ad-14a4-431e-83c9-ca613a832ee2 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] Returning 404 to user: Volume 8bbc8d3b-adec-4fa1-8178-f71c4de1107f could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:57.220277 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-280242ad-14a4-431e-83c9-ca613a832ee2 tempest-VolumesNegativeTest-1716825629 tempest-VolumesNegativeTest-1716825629-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8bbc8d3b-adec-4fa1-8178-f71c4de1107f" status: 404 len: 109 microversion: 2.1 time: 0.151069 Feb 17 04:33:57.220935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 24/32] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:33:57 2021] GET /compute/v2.1/os-volumes/8bbc8d3b-adec-4fa1-8178-f71c4de1107f => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:33:57.783596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:57.806513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-999029e8-6552-4213-abab-dcd7685a147d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1273 microversion: 2.1 time: 1.624815 Feb 17 04:33:57.819863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 9/33] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:56 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1273 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:58.839059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:58.839760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:58.866122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.873769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.874694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.875199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.307875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:59.325138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e88c13d3-398b-4793-a088-d3c43f3a301c tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1273 microversion: 2.1 time: 0.490100 Feb 17 04:33:59.326076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 25/34] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:58 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1273 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:00.344665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:00.345817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:00.381993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.383603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.384477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.384961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.733167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-48e0cdf9-9941-428f-95b9-31f25dc1f80f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'create', calling method: .version_select at 0x7f9b3d25cd90>, body: {"keypair": {"name": "tempest-keypair-327573917"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:00.859267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-48e0cdf9-9941-428f-95b9-31f25dc1f80f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:00.867175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-48e0cdf9-9941-428f-95b9-31f25dc1f80f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for user cd048d5803b14ad2b23a35d8f288002c and project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:01.240954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-48e0cdf9-9941-428f-95b9-31f25dc1f80f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:01.247466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-48e0cdf9-9941-428f-95b9-31f25dc1f80f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for user cd048d5803b14ad2b23a35d8f288002c and project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:01.267077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-48e0cdf9-9941-428f-95b9-31f25dc1f80f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.253039 Feb 17 04:34:01.274382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 10/35] 10.222.0.73 () {62 vars in 1189 bytes} [Wed Feb 17 04:34:00 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1261 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:34:01.833909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:01.858566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3cf2e745-2d5c-4a67-b843-6e77c8ddea1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 1.518881 Feb 17 04:34:01.863230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 26/36] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:00 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:02.882569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:02.883621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:02.901560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.902073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.903318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.903817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:03.952657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cadb2a05-eabb-4877-abd2-d110e65119aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: .version_select at 0x7f9b3db37400>, body: {"keypair": {"name": "tempest-keypair-132356022"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:04.346873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-cadb2a05-eabb-4877-abd2-d110e65119aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:04.373337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-cadb2a05-eabb-4877-abd2-d110e65119aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for user b46934d3d2dd4c129cc4359c322854e1 and project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:05.117793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:05.156003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e101ec61-36de-46db-9d1b-7133c68a30e6 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 2.278258 Feb 17 04:34:05.160810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 11/37] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:02 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:05.339951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-cadb2a05-eabb-4877-abd2-d110e65119aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:05.353273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-cadb2a05-eabb-4877-abd2-d110e65119aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for user b46934d3d2dd4c129cc4359c322854e1 and project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:05.420039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cadb2a05-eabb-4877-abd2-d110e65119aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 2.457279 Feb 17 04:34:05.421256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 27/38] 10.222.0.73 () {60 vars in 1148 bytes} [Wed Feb 17 04:34:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 2459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:06.181363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:06.182382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:06.207173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.215963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:06.217111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.219966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.108619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:09.113697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3846e976-3bf8-4722-98ce-913de61b47ee tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 2.938007 Feb 17 04:34:09.114840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 12/39] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:06 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:10.141274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:10.151955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:10.192217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.192722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.193597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.194060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.642243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-8b91c271-ca47-4ff9-a327-92a246d5f00e req-12ea9656-ac8c-40d9-a0c2-5a2322d12f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f38d61-fed7-40f6-9cd5-0d9c3ffc6437", "tag": "3e8c2c09-fc54-44db-900d-60ab887f70b2"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:11.644639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:11.644639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:11.678456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8b91c271-ca47-4ff9-a327-92a246d5f00e req-12ea9656-ac8c-40d9-a0c2-5a2322d12f55 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.678971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8b91c271-ca47-4ff9-a327-92a246d5f00e req-12ea9656-ac8c-40d9-a0c2-5a2322d12f55 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.981080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-8b91c271-ca47-4ff9-a327-92a246d5f00e req-12ea9656-ac8c-40d9-a0c2-5a2322d12f55 service nova] Creating event network-changed:3e8c2c09-fc54-44db-900d-60ab887f70b2 for instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 on hv-cinder-75995 Feb 17 04:34:11.984194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8b91c271-ca47-4ff9-a327-92a246d5f00e req-12ea9656-ac8c-40d9-a0c2-5a2322d12f55 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:34:11.999441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:12.001172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:12.002368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:12.003055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:12.015083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.compute.rpcapi [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 04:34:12.016584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:34:12.058900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2e140546-5ecc-4572-8579-ffe0eb9315e3 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583792 Feb 17 04:34:12.059878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 13/40] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:12.429008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:12.464060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2eb0d5b8-4546-44cf-8240-e50c3117dc65 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 2.329510 Feb 17 04:34:12.465248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 28/41] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:10 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:13.490878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:13.491694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:13.516538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.517025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.520448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.524240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.822021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:14.851450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-89b256e1-f235-41b1-9646-02008ba79222 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 1.369256 Feb 17 04:34:14.852339 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 14/42] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:13 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:15.878132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:15.878798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:15.902816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.903340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.911192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.911853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.231615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:17.244573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-af2a2b64-b68f-4fed-9146-2639dbd2c7c2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 1.372931 Feb 17 04:34:17.245775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 29/43] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:15 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:18.268502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:18.274436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:18.286793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:18.288058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:18.290160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:18.290959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:18.842437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:18.856101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0387d829-2044-4ea4-908d-5a6a1ba8fa0d tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.595444 Feb 17 04:34:18.856712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 15/44] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:18 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:18.865868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-389041898", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1045c1fd-b2e6-4a47-b34a-2f03f2ccfda3"}], "security_groups": [{"name": "tempest-securitygroup--1929106829"}], "key_name": "tempest-keypair-327573917", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:18.966033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1464692128", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e174343-ab03-4c52-a597-b1e3d9834772"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:19.099951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] validate_networks() for [('6e174343-ab03-4c52-a597-b1e3d9834772', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:34:19.138524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] validate_networks() for [('1045c1fd-b2e6-4a47-b34a-2f03f2ccfda3', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:34:20.128206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:34:20.129378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:34:20.130035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:34:20.130500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:34:20.130967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:34:20.147812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.148390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.160601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.161233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.209206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for project b4db349eea3a41deb61c89e67a673600. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:20.234581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for user cd048d5803b14ad2b23a35d8f288002c and project b4db349eea3a41deb61c89e67a673600. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:20.266708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:34:20.269550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:34:20.362955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:34:20.364093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:34:20.364645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:34:20.365113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:34:20.365631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:34:20.381887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.383795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.400011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-510660f5-8825-404b-aea4-8acad1fa1e9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.538496 Feb 17 04:34:20.401238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.402071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.404634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 16/45] 10.222.0.73 () {62 vars in 1178 bytes} [Wed Feb 17 04:34:18 2021] POST /compute/v2.1/servers => generated 402 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 04:34:20.414444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1838004993", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db318819-52ac-454a-9acd-88522654014f"}], "security_groups": [{"name": "tempest-securitygroup--987404704"}], "key_name": "tempest-keypair-132356022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:20.485701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Getting quotas for project 0e308712a7a343778981979df1c88348. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:20.492034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Getting quotas for user 27eb5c69b27948cf9454ae54e9468204 and project 0e308712a7a343778981979df1c88348. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:20.508803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:34:20.512924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:34:20.637504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] validate_networks() for [('db318819-52ac-454a-9acd-88522654014f', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:34:20.759593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-70ab34c0-cd6b-49e4-b5f0-a91f4746f07d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.373046 Feb 17 04:34:20.761209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 30/46] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:34:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:34:20.767913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:20.768891 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:20.790494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.796267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.799820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.801707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.182805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.198831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b4baa91c-7574-467d-a730-08f4c6938685 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.432619 Feb 17 04:34:21.202686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 31/47] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:20 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:21.209666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-07801816-5ff5-4fa3-976c-2a60a22988d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:21.214288 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-07801816-5ff5-4fa3-976c-2a60a22988d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:21.456512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-07801816-5ff5-4fa3-976c-2a60a22988d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.486117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-07801816-5ff5-4fa3-976c-2a60a22988d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.507098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-07801816-5ff5-4fa3-976c-2a60a22988d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.508416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-07801816-5ff5-4fa3-976c-2a60a22988d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1280 microversion: 2.20 time: 0.307827 Feb 17 04:34:21.509035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 32/48] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:21 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1280 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:21.517059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ee5bf588-d99d-4a73-800e-d685848dc164 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:21.517775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ee5bf588-d99d-4a73-800e-d685848dc164 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:21.603508 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:34:21.603991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:34:21.604532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:34:21.604993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:34:21.605454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:34:21.616474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.621333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.621974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.622483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.669810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ee5bf588-d99d-4a73-800e-d685848dc164 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.683222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ee5bf588-d99d-4a73-800e-d685848dc164 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1222 microversion: 2.1 time: 0.172269 Feb 17 04:34:21.689150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 33/49] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:21 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:21.689788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:21.704944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for user b46934d3d2dd4c129cc4359c322854e1 and project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:21.742854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:34:21.745416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:34:21.915531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-65787d47-d609-4869-bc04-729e24124730 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.509211 Feb 17 04:34:21.916481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 17/50] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:34:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:34:21.925716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-589570829", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e174343-ab03-4c52-a597-b1e3d9834772"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:21.934774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0111b5a9-9d8e-440a-941d-f6291d5e7bcd tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:21.935500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0111b5a9-9d8e-440a-941d-f6291d5e7bcd tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:22.113588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] validate_networks() for [('6e174343-ab03-4c52-a597-b1e3d9834772', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:34:22.146347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0111b5a9-9d8e-440a-941d-f6291d5e7bcd tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:22.158911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0111b5a9-9d8e-440a-941d-f6291d5e7bcd tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1237 microversion: 2.1 time: 0.227893 Feb 17 04:34:22.160823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 18/51] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:21 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1237 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:22.218810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:22.219534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:22.236883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.237383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.239228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.240022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.672588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:22.685871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-de0ad2e7-dc37-4639-b8c1-aa97fde303f1 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.472449 Feb 17 04:34:22.686949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 19/52] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:22 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:22.700851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:22.701527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:22.722073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.722073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.728837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.729730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.949827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:22.961460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:22.963569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:22.964958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-936a58f8-4d0a-448d-9a77-7a93e2db2ed0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1284 microversion: 2.20 time: 0.272015 Feb 17 04:34:22.965741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 20/53] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:22 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:22.995094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:34:22.995608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:34:22.996201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:34:22.996713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:34:22.997171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:34:23.007908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:23.008379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.009411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:23.010048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.029432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Getting quotas for project 0e308712a7a343778981979df1c88348. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:23.033604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Getting quotas for user 27eb5c69b27948cf9454ae54e9468204 and project 0e308712a7a343778981979df1c88348. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:23.045568 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:34:23.048316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:34:23.142607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dcdea8a5-5465-425a-a0fa-70f92233a7c8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.222027 Feb 17 04:34:23.149496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 34/54] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:34:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:34:23.154512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-478b4bf6-33d4-4caa-82ee-2d33d0c86c4c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:23.155645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-478b4bf6-33d4-4caa-82ee-2d33d0c86c4c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:23.184808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:23.185694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:23.200382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:23.201085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.202117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:23.202790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.276865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-478b4bf6-33d4-4caa-82ee-2d33d0c86c4c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:23.288383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-478b4bf6-33d4-4caa-82ee-2d33d0c86c4c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1221 microversion: 2.1 time: 0.137804 Feb 17 04:34:23.298957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 21/55] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:23 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:23.389014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:23.398280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9e005ffe-7e90-4e6f-b2aa-d4f62aa3057f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1241 microversion: 2.1 time: 0.221263 Feb 17 04:34:23.398894 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 35/56] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:23 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1241 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:23.705546 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:23.706536 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:23.718804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:23.719434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.720304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:23.720794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.991628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:23.995417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:24.051640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.052967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.054068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.055621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.123813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.150147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1b4b692f-0e07-42da-9e96-4a7cbbd2a879 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.449211 Feb 17 04:34:24.150974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 22/57] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:23 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:24.312093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:24.313432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:24.326864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.328006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.329690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.330482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.396089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.408185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.411404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.412765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0b656e84-ed65-497d-b1a9-3cc264f0f769 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1284 microversion: 2.20 time: 0.430084 Feb 17 04:34:24.413548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 36/58] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:23 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1284 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:24.418586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:24.419556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:24.430396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.431196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.432306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.432979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.542095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.560230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d7672a0a-d7c0-4c92-9871-bef74b40d503 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1225 microversion: 2.1 time: 0.254558 Feb 17 04:34:24.570919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 23/59] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:24 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:24.655328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.670159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c3c4b0e6-46b7-4456-993c-453ab942b8af tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1233 microversion: 2.1 time: 0.255197 Feb 17 04:34:24.671180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 37/60] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:24 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1233 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:25.175833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:25.177207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:25.189594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.190495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.193478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.195050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.434647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:25.436683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:25.456641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.458039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.460217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.465444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.670219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:25.688505 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:25.761986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:25.761986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5320253b-2b0a-48a4-b129-21cc3faf16d1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1332 microversion: 2.20 time: 0.278875 Feb 17 04:34:25.761986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 38/61] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:25 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1332 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:34:25.849859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:25.861450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e98b9a6a-d7d4-497b-985d-a54fbb7184ce tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.690918 Feb 17 04:34:25.872459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 24/62] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:25 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:25.877728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:25.878416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:25.897640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.898260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.899174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.899736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.899850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-9c4fa9e8-4289-4558-8140-1de7c6cef9c4 req-86e5ea39-6b14-4b2f-bec2-709314fb7b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f38d61-fed7-40f6-9cd5-0d9c3ffc6437", "name": "network-vif-plugged", "status": "completed", "tag": "3e8c2c09-fc54-44db-900d-60ab887f70b2"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:25.902635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:25.902635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:25.914291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9c4fa9e8-4289-4558-8140-1de7c6cef9c4 req-86e5ea39-6b14-4b2f-bec2-709314fb7b31 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.914291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9c4fa9e8-4289-4558-8140-1de7c6cef9c4 req-86e5ea39-6b14-4b2f-bec2-709314fb7b31 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.945753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-9c4fa9e8-4289-4558-8140-1de7c6cef9c4 req-86e5ea39-6b14-4b2f-bec2-709314fb7b31 service nova] Creating event network-vif-plugged:3e8c2c09-fc54-44db-900d-60ab887f70b2 for instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 on hv-cinder-75995 Feb 17 04:34:25.946868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9c4fa9e8-4289-4558-8140-1de7c6cef9c4 req-86e5ea39-6b14-4b2f-bec2-709314fb7b31 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:34:25.949142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.949660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.950816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.951450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.973082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.compute.rpcapi [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 04:34:25.973082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] Releasing lock "compute-rpcapi-router" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:34:26.024326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d5fc3de0-f62a-4417-af68-28e4c43b3b0f None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307005 Feb 17 04:34:26.025305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 39/63] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:26.034234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:26.035807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:26.048382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.048977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.049922 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.050501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.114244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.135699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e72ca7ca-f24c-4bc1-ba64-7e0b59a8994e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1217 microversion: 2.1 time: 0.261749 Feb 17 04:34:26.136809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 25/64] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:25 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:26.224934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.233965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f22f39fe-1338-4735-943a-8b4879774932 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1233 microversion: 2.1 time: 0.205115 Feb 17 04:34:26.234596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 40/65] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:26 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1233 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:26.782485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:26.783139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:26.791026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.791595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.792436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.792924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.881262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:26.882166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:26.891243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.891814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.892708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.893339 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.927989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.938316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.940086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.942676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-00824958-555e-40ac-b181-3f5c58da90ec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1332 microversion: 2.20 time: 0.162882 Feb 17 04:34:26.946421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 26/66] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:26 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1332 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:27.161347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:27.162810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:27.179347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.180521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.182161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.183148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.300069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:27.311440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e9de7a91-5eb7-4e1e-8f60-0506731f0ad8 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.435230 Feb 17 04:34:27.312474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 41/67] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:26 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:27.317721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:27.318562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:27.327587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.328302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.329373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.330069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.393930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:27.409450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9812a818-8c58-449c-879c-1baaad39cc77 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1217 microversion: 2.1 time: 0.256898 Feb 17 04:34:27.411049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 27/68] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:27 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:27.467238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:27.484793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-743ae832-5147-4c0a-8a99-e63cbdffb102 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1233 microversion: 2.1 time: 0.170323 Feb 17 04:34:27.486183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 42/69] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:27 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1233 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:27.961446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:27.962319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:27.970365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.970880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.971779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.972275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.112471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:28.123958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:28.128209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:28.130861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4666526a-fcb7-465e-9bee-0d514db960c6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1332 microversion: 2.20 time: 0.172780 Feb 17 04:34:28.131888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 28/70] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:27 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:28.337770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:28.338446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:28.353329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.353843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.354723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.355223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.431274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:28.432329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:28.453378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.460123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.461320 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.464583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.889691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:28.909081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f920563c-1797-40c1-b456-8535f53f3abc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1217 microversion: 2.1 time: 0.484348 Feb 17 04:34:28.915643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 29/71] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:28 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1217 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:28.915643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:28.916303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:28.930994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.932134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.933530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.934342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.136552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:29.142425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:29.149781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-741e059e-03d5-42a5-b332-11e0cd054917 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.816019 Feb 17 04:34:29.153051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 43/72] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:28 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:29.159665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c3db9849-881f-4a42-a26c-f6bfafc621f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1289 microversion: 2.1 time: 0.247996 Feb 17 04:34:29.160808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 30/73] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:28 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1289 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:29.168213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:29.170985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:29.184825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:29.185342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.186391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:29.186868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.347014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:29.357213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:29.358797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:29.359951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c5fea048-c966-48d8-8fb0-dea638d3f563 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1340 microversion: 2.20 time: 0.199299 Feb 17 04:34:29.360550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 44/74] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:29 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:29.935255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:29.936008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:29.949947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:29.950479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.951602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:29.952114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.181708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:30.181708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:30.188607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.189123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.190037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.190531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.232171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.245910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5adb4429-e0ce-4830-99c0-ec28ce143aa3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1217 microversion: 2.1 time: 0.317929 Feb 17 04:34:30.246527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 31/75] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:29 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:30.260241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:30.261354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:30.270577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.271257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.272294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.272946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.406404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.416407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e68cfed2-1e0a-4374-9f1e-a9b485974a89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1289 microversion: 2.1 time: 0.168735 Feb 17 04:34:30.417016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 32/76] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:30 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1289 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:30.422148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:30.422971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:30.431233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.431793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.432630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.433285 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.482102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.492245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-02f45da8-b64f-4400-bd3a-91e91c975342 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.319094 Feb 17 04:34:30.493059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 45/77] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:30 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:30.579954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.595071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.598476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.600621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-60943d9f-e9d5-4fa3-8d51-1d5e2d195097 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1340 microversion: 2.20 time: 0.182251 Feb 17 04:34:30.601931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 33/78] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:30 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1340 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:31.264477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:31.265127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:31.273935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.274666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.275759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.276542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.411118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:31.422459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f4a07a6d-a144-4a9f-9906-287c06e87e47 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1217 microversion: 2.1 time: 0.161901 Feb 17 04:34:31.423080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 46/79] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:31 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:31.438264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:31.438939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:31.447567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.448076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.448932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.449433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.516390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:31.517695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:31.533587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.534537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.536425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.537466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.608817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:31.618187 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b17075da-c202-448c-bdcb-0a2d6ca5abb5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1289 microversion: 2.1 time: 0.186712 Feb 17 04:34:31.618797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 34/80] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:31 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1289 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:31.627844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:31.629579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:31.639481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.640784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.642608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.644017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.923263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:31.949720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:31.955927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:31.973451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1502e142-4105-4fd3-824b-f99a14d1309d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1340 microversion: 2.20 time: 0.336564 Feb 17 04:34:31.976365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 35/81] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:31 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1340 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:34:32.029795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:32.052178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9a9dc447-0272-4612-9d86-b17c26ba81bf tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.542983 Feb 17 04:34:32.053627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 47/82] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:31 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:32.443032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:32.444420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:32.457351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:32.459426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:32.461389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:32.462257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:32.636696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:32.637986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:32.648728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:32.649873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:32.650954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:32.651827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:32.712833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:32.725181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e2fb6046-2737-4f92-9822-f42c437a17c1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1273 microversion: 2.1 time: 0.287942 Feb 17 04:34:32.740814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 36/83] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:32 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:32.969360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:32.981380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5c78ab33-4193-42c0-a4f1-622a65683c17 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1307 microversion: 2.1 time: 0.348460 Feb 17 04:34:32.992737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 48/84] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:32 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:33.006245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:33.006915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:33.020055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.020642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.021786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.022129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.085483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:33.086436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:33.101971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.105087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.106162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.109323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.474361 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:33.494576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:33.496521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:33.497707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8bedfade-6bd8-42cb-9fe2-4e0fe3c39147 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1338 microversion: 2.20 time: 0.495541 Feb 17 04:34:33.509994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 37/85] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:33 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1338 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:33.757255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:33.757892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:33.779162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.779759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.780676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.781246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.945277 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:33.969115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b8c38702-a584-4aff-8116-ec3844a5c459 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1315 microversion: 2.1 time: 0.887446 Feb 17 04:34:33.970770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 49/86] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:33 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:34.008737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:34.010471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:34.043912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:34.045853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:34.048767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:34.050438 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:34.130182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.148333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6d6e5227-221d-4c16-bec5-f259fda0e531 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1279 microversion: 2.1 time: 0.395463 Feb 17 04:34:34.149665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 38/87] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:33 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1279 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:34.505136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.524019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:34.534270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:34.541533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ebe60d24-8559-4484-b80b-e8119ef3049d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1295 microversion: 2.1 time: 0.542148 Feb 17 04:34:34.542707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 50/88] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:33 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1295 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:34.564925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:34.568313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:34.571832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:34.572716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:34.848235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.874388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.885105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.887264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b3d018d4-f667-4623-a01f-93d7ed770ba9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1338 microversion: 2.20 time: 0.372524 Feb 17 04:34:34.888229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 39/89] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:34 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1338 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:34.997598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:34.998384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:35.009247 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.010917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.011880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.012697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.187156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:35.187883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:35.204805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.205491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.217842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.218490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.586242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:35.614058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e71f52ca-fd4a-4be9-a579-f93277b0d0df tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1279 microversion: 2.1 time: 0.431525 Feb 17 04:34:35.615258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 40/90] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:35 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1279 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:35.620447 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:35.621385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:35.640213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.656219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.657444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.668187 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.936857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:35.960225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-401e7eb5-a544-44c3-b1e8-48776cf63d6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1295 microversion: 2.1 time: 0.343481 Feb 17 04:34:35.963205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 41/91] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:35 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1295 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:35.991198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:35.993443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:36.010499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.011109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.012403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.013020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.304696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.334544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-53088bb1-f4f2-47cd-90e9-83c039fe5824 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1502 microversion: 2.1 time: 1.340743 Feb 17 04:34:36.336904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 51/92] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:34 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1502 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:36.369906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-2e1469a1-12a8-4ed9-a0eb-692c0186d262 req-677c6deb-723b-4db7-a6a3-c407f0f410a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2641c971-9a8a-467c-92f1-1317f397e36f", "tag": "0bf5f471-d184-4e72-bf60-7bbf55b896ba"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:36.375781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:36.375781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:36.398768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-2e1469a1-12a8-4ed9-a0eb-692c0186d262 req-677c6deb-723b-4db7-a6a3-c407f0f410a9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.399308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-2e1469a1-12a8-4ed9-a0eb-692c0186d262 req-677c6deb-723b-4db7-a6a3-c407f0f410a9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.443398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-2e1469a1-12a8-4ed9-a0eb-692c0186d262 req-677c6deb-723b-4db7-a6a3-c407f0f410a9 service nova] Creating event network-changed:0bf5f471-d184-4e72-bf60-7bbf55b896ba for instance 2641c971-9a8a-467c-92f1-1317f397e36f on hv-cinder-75995 Feb 17 04:34:36.463540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-2e1469a1-12a8-4ed9-a0eb-692c0186d262 req-677c6deb-723b-4db7-a6a3-c407f0f410a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112084 Feb 17 04:34:36.464551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 52/93] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:36.649006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:36.653399 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:36.677937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.678450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.679328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.682876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.730190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.749337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.751121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.761342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2bc576fe-d483-4d03-8111-2089862390a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.790531 Feb 17 04:34:36.762455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 42/94] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:35 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:36.982785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:36.983708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:36.999913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.000741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.001777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.002551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.133150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:37.155153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-61d95b5c-3261-4473-924c-b91b0bdb2eb5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 0.515618 Feb 17 04:34:37.156078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 53/95] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:36 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:37.884315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:37.884315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:37.884315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.884315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.885758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.885758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.886334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:37.886334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ee442082-d7d8-4b6a-aeac-448c72428e0c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.868334 Feb 17 04:34:37.886334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 43/96] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:36 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:38.184892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:38.184892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:38.191741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:38.192363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:38.193300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:38.193795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:38.230975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:38.234972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:38.236791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:38.237993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a47f57ef-ce3f-4532-bd92-8b7f18b725a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.460021 Feb 17 04:34:38.238670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 54/97] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:37 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:38.866898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:38.868253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:38.896839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:38.897392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:38.898209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:38.898706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:39.916635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:39.953939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-729f40ef-a722-4ebb-b54e-ea570e4ae952 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 1.780932 Feb 17 04:34:39.956079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 44/98] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:38 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:39.968895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:39.970612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:39.992987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:39.994759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:39.997161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:39.998375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:40.371304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:40.401489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-68783ffb-7e48-4a0e-a5d3-fbad264678bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 1.539719 Feb 17 04:34:40.402451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 55/99] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:38 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:40.407945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1a8fd8e-056c-440c-b87b-178b210a94ac"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:40.411738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:40.422605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:40.423400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:40.424388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:40.437805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:40.957654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:40.986366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:40.988093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:40.991483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-03f4e0fb-4201-4eeb-bd37-c49fb0a44611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 1.032990 Feb 17 04:34:40.992129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 45/100] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:39 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:41.008293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:41.009056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:41.038747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:41.039267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:41.047829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:41.048520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:42.365483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:42.378358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-38071008-057e-4754-ae05-893f058deb28 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 1.384512 Feb 17 04:34:42.379331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 46/101] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:40 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:42.391828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:42.398358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:42.430269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:42.436422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:42.437354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:42.438370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:42.616945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d81383dc-20e7-4217-b246-61c2993c7ec0 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "POST /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.210055 Feb 17 04:34:42.616945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 56/102] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:34:40 2021] POST /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437/os-volume_attachments => generated 194 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:42.627076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:42.635010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:42.679204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:42.682115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:42.685668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:42.688426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:43.316552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:43.345635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8f0dee44-9e4f-47f4-8890-0e836407b0ab tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.961997 Feb 17 04:34:43.354489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 47/103] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:42 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:43.415500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:43.419195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:43.433818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:43.440903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:43.440903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:43.440903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:43.950014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:43.967863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-02caa408-d436-4ceb-855a-e82c20877f0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 0.559620 Feb 17 04:34:43.972619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 48/104] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:43 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:43.979679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-f59e82f2-cd27-4522-9127-b0be9952d4da req-5f7b218c-3d6e-44db-a633-a349f44881d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa1b30cc-269e-4de0-af2c-4e4b530decbd", "tag": "80762b6b-ff48-48a7-b0f1-5e9fbb1583c0"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:43.987947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:43.987947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:44.009678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f59e82f2-cd27-4522-9127-b0be9952d4da req-5f7b218c-3d6e-44db-a633-a349f44881d6 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:44.010558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f59e82f2-cd27-4522-9127-b0be9952d4da req-5f7b218c-3d6e-44db-a633-a349f44881d6 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:44.032215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-f59e82f2-cd27-4522-9127-b0be9952d4da req-5f7b218c-3d6e-44db-a633-a349f44881d6 service nova] Creating event network-changed:80762b6b-ff48-48a7-b0f1-5e9fbb1583c0 for instance aa1b30cc-269e-4de0-af2c-4e4b530decbd on hv-cinder-75995 Feb 17 04:34:44.044103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-f59e82f2-cd27-4522-9127-b0be9952d4da req-5f7b218c-3d6e-44db-a633-a349f44881d6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068196 Feb 17 04:34:44.056786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 49/105] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:44.175242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:44.187262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:44.189237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:44.210098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-291c4a97-5f9e-4250-8baa-e51371a996c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 1.592880 Feb 17 04:34:44.224309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 57/106] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:42 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:44.376567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:44.377897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:44.399182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:44.400180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:44.401226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:44.403854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:44.780323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-f3daae9a-7c39-4936-ab8c-c7cff837690a req-f35ae92a-a00e-4e98-ad3e-b97e54896264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe67c43f-82ea-4944-a563-9fed39d42080", "tag": "7c039b81-545d-4b96-8225-5c9d5bbd4f40"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:44.782331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:44.782331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:44.814122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f3daae9a-7c39-4936-ab8c-c7cff837690a req-f35ae92a-a00e-4e98-ad3e-b97e54896264 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:44.819994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f3daae9a-7c39-4936-ab8c-c7cff837690a req-f35ae92a-a00e-4e98-ad3e-b97e54896264 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:44.856612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-f3daae9a-7c39-4936-ab8c-c7cff837690a req-f35ae92a-a00e-4e98-ad3e-b97e54896264 service nova] Creating event network-changed:7c039b81-545d-4b96-8225-5c9d5bbd4f40 for instance fe67c43f-82ea-4944-a563-9fed39d42080 on hv-cinder-75995 Feb 17 04:34:44.869508 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-f3daae9a-7c39-4936-ab8c-c7cff837690a req-f35ae92a-a00e-4e98-ad3e-b97e54896264 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296278 Feb 17 04:34:44.875037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 58/107] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:34:44.991839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:44.996128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:45.016641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:45.017348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:45.018352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:45.032033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:45.249991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:45.261135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-426c6098-78e2-41de-99a8-843c4543c2b3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.890322 Feb 17 04:34:45.262304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 50/108] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:44 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:45.271146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:45.277244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:45.299145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:45.304371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:45.304371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:45.304371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:45.809271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:45.822209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:45.826580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:45.835722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7bbdeda2-49e1-4ee1-8903-774bb5b50bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.571649 Feb 17 04:34:45.837431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 51/109] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:45 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:45.978901 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-5d11f56b-6f60-460c-a636-b91bb60e69ce req-54c98408-84db-400f-906e-b4f515bdd693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2641c971-9a8a-467c-92f1-1317f397e36f", "name": "network-vif-plugged", "status": "completed", "tag": "0bf5f471-d184-4e72-bf60-7bbf55b896ba"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:45.989024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:45.989024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:46.001821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-5d11f56b-6f60-460c-a636-b91bb60e69ce req-54c98408-84db-400f-906e-b4f515bdd693 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:46.003211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-5d11f56b-6f60-460c-a636-b91bb60e69ce req-54c98408-84db-400f-906e-b4f515bdd693 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.025988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-5d11f56b-6f60-460c-a636-b91bb60e69ce req-54c98408-84db-400f-906e-b4f515bdd693 service nova] Creating event network-vif-plugged:0bf5f471-d184-4e72-bf60-7bbf55b896ba for instance 2641c971-9a8a-467c-92f1-1317f397e36f on hv-cinder-75995 Feb 17 04:34:46.032206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-5d11f56b-6f60-460c-a636-b91bb60e69ce req-54c98408-84db-400f-906e-b4f515bdd693 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057024 Feb 17 04:34:46.035842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 52/110] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:46.263066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:46.277803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-11a3e4a2-0eb7-434c-9603-2820d887c6f0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 1.291103 Feb 17 04:34:46.282186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 59/111] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:44 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:46.287796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:46.288582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:46.329612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:46.329612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.329612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:46.329612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.801049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:46.812201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8a9b9ca0-7d6b-4aea-b85f-342f6d1bb48f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.529362 Feb 17 04:34:46.817692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 53/112] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:46 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:46.858084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:46.858870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:46.868945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:46.869461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.870300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:46.870803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.919706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-c1b4a746-65ba-48ce-824f-9aca7990c8b3 req-1865b5e6-754c-4ef2-8ead-c277d8179ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:46.925387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:46.925387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:46.938159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-c1b4a746-65ba-48ce-824f-9aca7990c8b3 req-1865b5e6-754c-4ef2-8ead-c277d8179ad2 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:46.939059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-c1b4a746-65ba-48ce-824f-9aca7990c8b3 req-1865b5e6-754c-4ef2-8ead-c277d8179ad2 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.965247 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-c1b4a746-65ba-48ce-824f-9aca7990c8b3 req-1865b5e6-754c-4ef2-8ead-c277d8179ad2 service nova] Creating event network-changed:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:34:46.973177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-c1b4a746-65ba-48ce-824f-9aca7990c8b3 req-1865b5e6-754c-4ef2-8ead-c277d8179ad2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062281 Feb 17 04:34:46.974818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 54/113] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:47.303350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:47.304708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:47.321024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:47.321546 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:47.322481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:47.323115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:47.511457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.530071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.533219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.536392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6687a014-40a0-445b-a722-dafa02c74bca tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.683835 Feb 17 04:34:47.545605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 60/114] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:46 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:47.666999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.685566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-488f2d50-53eb-4ba2-9e31-84140a816607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 0.388229 Feb 17 04:34:47.688197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 55/115] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:47 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:47.834766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:47.835594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:47.853363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:47.853883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:47.863161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:47.863865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:48.054383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b81dfe91-6b15-4636-9990-ad4ebcca6ed6 req-cd6e01ee-87a1-47f5-a68c-143776d9095a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1b30cc-269e-4de0-af2c-4e4b530decbd", "name": "network-vif-plugged", "status": "completed", "tag": "80762b6b-ff48-48a7-b0f1-5e9fbb1583c0"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:48.056148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:48.056148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:48.076393 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b81dfe91-6b15-4636-9990-ad4ebcca6ed6 req-cd6e01ee-87a1-47f5-a68c-143776d9095a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.077215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b81dfe91-6b15-4636-9990-ad4ebcca6ed6 req-cd6e01ee-87a1-47f5-a68c-143776d9095a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:48.146739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b81dfe91-6b15-4636-9990-ad4ebcca6ed6 req-cd6e01ee-87a1-47f5-a68c-143776d9095a service nova] Creating event network-vif-plugged:80762b6b-ff48-48a7-b0f1-5e9fbb1583c0 for instance aa1b30cc-269e-4de0-af2c-4e4b530decbd on hv-cinder-75995 Feb 17 04:34:48.154675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b81dfe91-6b15-4636-9990-ad4ebcca6ed6 req-cd6e01ee-87a1-47f5-a68c-143776d9095a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105027 Feb 17 04:34:48.156922 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 56/116] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:48.556862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:48.557572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:48.578477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.579530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:48.581232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.582081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:48.590549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:48.601558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-577c1916-fc71-4fe2-8dec-61a25edd46cc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.772945 Feb 17 04:34:48.603782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 61/117] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:47 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:48.717054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:48.719040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:48.729231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.730051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:48.732655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.733344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:49.122766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.133534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.135159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.136684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-92eeaeaa-d7b6-4476-bc56-5ed32d5703d8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.584600 Feb 17 04:34:49.137458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 57/118] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:48 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:49.374066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.391087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3facd7c3-6b4e-46d1-869d-409848317ecb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 0.690826 Feb 17 04:34:49.391849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 62/119] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:48 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:49.623153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:49.623976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:49.634717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:49.635224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:49.636111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:49.636604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:49.903938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.913620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-aa137ea7-a416-494d-92f3-b51486f0e349 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.294634 Feb 17 04:34:49.914722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 58/120] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:49 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:50.161144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:50.161983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:50.169821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.170334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.171477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.171976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.410911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:50.412156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:50.423515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.427502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.431805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.432721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.478278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.489434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.491232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.492615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0e91ae1a-d85c-49e0-9a62-e9eeb8c0f534 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.335640 Feb 17 04:34:50.493395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 63/121] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:50 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:50.503949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-7f0abebf-9db6-4817-aa10-3a53df14a460 req-748221bf-807a-4dce-9210-135b138c1704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "name": "network-vif-plugged", "status": "completed", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:50.506735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:50.506735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:50.539481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-7f0abebf-9db6-4817-aa10-3a53df14a460 req-748221bf-807a-4dce-9210-135b138c1704 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.540031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-7f0abebf-9db6-4817-aa10-3a53df14a460 req-748221bf-807a-4dce-9210-135b138c1704 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.572597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-7f0abebf-9db6-4817-aa10-3a53df14a460 req-748221bf-807a-4dce-9210-135b138c1704 service nova] Creating event network-vif-plugged:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:34:50.578996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-7f0abebf-9db6-4817-aa10-3a53df14a460 req-748221bf-807a-4dce-9210-135b138c1704 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081486 Feb 17 04:34:50.580320 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 64/122] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:34:50.788135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.802033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7c4d9679-a7d6-4b62-93d8-c152aad71f6f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1321 microversion: 2.1 time: 0.396210 Feb 17 04:34:50.802911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 59/123] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:50 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:50.944700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:50.944700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:50.961812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.962233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.963120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.963658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:51.443224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:51.469278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b77a6b14-04d7-413a-8490-0291a58fefce tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.531529 Feb 17 04:34:51.470451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 65/124] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:50 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:51.513961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:51.519716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:51.531505 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:51.532513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:51.534144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:51.535065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:51.821797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:51.823112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:51.839104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:51.842807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:51.844142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:51.847478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.064308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.080225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.082692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.092454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e49f1d40-003f-4449-907d-8dbf60115063 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1406 microversion: 2.20 time: 0.579576 Feb 17 04:34:52.093457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 60/125] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:51 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1406 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:52.264197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.273816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a9bd84a0-2fca-41aa-88b1-2e1f1271e1d6 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1516 microversion: 2.1 time: 0.456821 Feb 17 04:34:52.276597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 66/126] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:51 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1516 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:52.298458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:52.300679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:52.309838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.310549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.311457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.311963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.381457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lazy-loading 'flavor' on Instance uuid aa1b30cc-269e-4de0-af2c-4e4b530decbd {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:34:52.497883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:52.499530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:52.513151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.513861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.514888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.515591 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.788188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-eadd6fd8-f110-4848-882a-635ee28d90da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd/action" status: 200 len: 32 microversion: 2.1 time: 0.491508 Feb 17 04:34:52.789321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 61/127] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:34:52 2021] POST /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd/action => generated 32 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:34:52.798460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-cd56fc46-b083-4474-8c4a-88fdf2c69d63 req-86db2cc5-5c36-4bf7-8a8a-cf48bf0a76f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe67c43f-82ea-4944-a563-9fed39d42080", "name": "network-vif-plugged", "status": "completed", "tag": "7c039b81-545d-4b96-8225-5c9d5bbd4f40"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:52.801226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:52.801226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:52.817242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-cd56fc46-b083-4474-8c4a-88fdf2c69d63 req-86db2cc5-5c36-4bf7-8a8a-cf48bf0a76f5 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.817634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-cd56fc46-b083-4474-8c4a-88fdf2c69d63 req-86db2cc5-5c36-4bf7-8a8a-cf48bf0a76f5 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.842911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-cd56fc46-b083-4474-8c4a-88fdf2c69d63 req-86db2cc5-5c36-4bf7-8a8a-cf48bf0a76f5 service nova] Creating event network-vif-plugged:7c039b81-545d-4b96-8225-5c9d5bbd4f40 for instance fe67c43f-82ea-4944-a563-9fed39d42080 on hv-cinder-75995 Feb 17 04:34:52.848724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-cd56fc46-b083-4474-8c4a-88fdf2c69d63 req-86db2cc5-5c36-4bf7-8a8a-cf48bf0a76f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056853 Feb 17 04:34:52.849828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 62/128] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:52.856175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:52.857140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:52.865986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.866740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.868494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:52.869152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.888470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.905166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f8a29c36-461f-45e1-8e9c-681d0f5a16c3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.412692 Feb 17 04:34:52.918967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 67/129] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:52 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:53.112148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:53.112850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:53.121791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.122332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.123746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.124277 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.141007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.151253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-65c9db0e-a086-4de9-912e-0c3cd04b3c9f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.299755 Feb 17 04:34:53.163332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 63/130] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:52 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:53.630513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:53.631096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:53.665140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.665659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.666538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.667037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.734960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:34:53.896901 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.906645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.908543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.909931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-db597c03-72a7-4570-bf15-7acd97e8d72e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1599 microversion: 2.20 time: 0.802529 Feb 17 04:34:53.910675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 68/131] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:53 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1599 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:34:53.933886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:53.937704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:53.944708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.945595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.946741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.947517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.051971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a798f6fb-a0ed-4d07-b09f-c459d668caf2 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "DELETE /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 204 len: 0 microversion: 2.1 time: 0.424755 Feb 17 04:34:54.053197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 64/132] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:34:53 2021] DELETE /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:34:54.069262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:54.070239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:54.148980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:54.149678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.150813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:54.151507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.509862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:54.523158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5a394ae7-e1e5-4d2d-ac3f-575d1cbcfb6c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.593863 Feb 17 04:34:54.525553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 69/133] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:53 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:54.531709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:54.537478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:54.555473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:54.558064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.559168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:54.562071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.610523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6345ebdb-ebc4-4a9e-8992-4b1bbd23fd08 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.555559 Feb 17 04:34:54.612191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 65/134] 10.222.0.73 () {60 vars in 1306 bytes} [Wed Feb 17 04:34:54 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-interface => generated 285 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:34:54.622965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:54.623727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:54.645710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:54.646314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.647458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:54.647590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.975126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:54.986276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9301ccf9-0ef3-4d70-b90d-90fdde902f1f tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 0.459125 Feb 17 04:34:54.987533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 70/135] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:54 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:55.325180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:55.352291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0b1626a7-e482-4a28-9ebb-494f8d33ef33 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.732757 Feb 17 04:34:55.353333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 66/136] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:54 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:55.554853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:55.556649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:55.587827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:55.589953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:55.592391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:55.593345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:55.895164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:55.905609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a0e523d7-8269-4a1f-a509-d5710ed51586 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.361858 Feb 17 04:34:55.906394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 71/137] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:55 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:56.006382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:56.011163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:56.015379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.015896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.016761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.017312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.372766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:56.373514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:56.383757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.389329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.390305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.390820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.667522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:56.680152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d5eac986-354e-4f3f-87ec-246e516c991a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.311805 Feb 17 04:34:56.680880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 72/138] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:56 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:56.927259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:56.928148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:56.936702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.937200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.938289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.938789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.985147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:57.007120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a93ecb75-65dd-4043-a4d1-40b53358d375 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 1.004839 Feb 17 04:34:57.008611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 67/139] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:55 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:57.230679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:57.245580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6d0e753b-777a-43bf-89df-826bc6aa0f96 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.322788 Feb 17 04:34:57.245580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 73/140] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:56 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:57.683462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-8860f039-ceba-4235-8bfe-b4c014cf5f80 req-e34469a1-091f-4727-bf2f-5bd6382126eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:57.683462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:57.683462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:34:57.683462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8860f039-ceba-4235-8bfe-b4c014cf5f80 req-e34469a1-091f-4727-bf2f-5bd6382126eb service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:57.688075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8860f039-ceba-4235-8bfe-b4c014cf5f80 req-e34469a1-091f-4727-bf2f-5bd6382126eb service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:57.714374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:57.714374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:57.722065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:57.723509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:57.725622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:57.726912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:57.754381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-8860f039-ceba-4235-8bfe-b4c014cf5f80 req-e34469a1-091f-4727-bf2f-5bd6382126eb service nova] Creating event network-changed:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:34:57.765282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-8860f039-ceba-4235-8bfe-b4c014cf5f80 req-e34469a1-091f-4727-bf2f-5bd6382126eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112853 Feb 17 04:34:57.767355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 68/141] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:57.779525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:57.781095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:57.798244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:57.800159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:57.802604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:57.804351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.178973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:58.190328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-23b20bdf-00b1-419a-a2aa-96405df087ec tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.419835 Feb 17 04:34:58.191541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 69/142] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:57 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:58.197975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:58.199196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:58.208874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:58.209584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.210431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:58.211218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.280890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-78ddbafc-8af3-42a8-90fd-ed16db58e5b2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 14 microversion: 2.20 time: 0.587517 Feb 17 04:34:58.285235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 74/143] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:34:57 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 14 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:58.297170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:58.298628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:58.309444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:58.310040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.310916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:58.323676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.609181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:58.622373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-18b103b9-2f50-4384-a2b7-00cada505c5e tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 0.429125 Feb 17 04:34:58.624175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 70/144] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:58 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:59.209632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:59.213784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:59.214848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:59.232344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a72af01a-adf9-4d27-87b0-37a77977e956 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1362 microversion: 2.1 time: 0.936103 Feb 17 04:34:59.232344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 75/145] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:58 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1362 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:59.232502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.232502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.232502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.232502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.297973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:59.300003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:59.312729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.313344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.314216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.314737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.562930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:59.585944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7febe171-a788-4e42-bcbc-fdd80f46bea9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.376826 Feb 17 04:34:59.596884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 71/146] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:59 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:59.656694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:59.657343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:59.671004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.671544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.672400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.672888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.939926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:59.971817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-45d335e8-d05d-461b-b51f-cdfeb138b44a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 0.305349 Feb 17 04:34:59.971817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 72/147] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:59 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:00.243323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:00.244320 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:00.252303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.252926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.253858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.254271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.502595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:00.520884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ef512cdd-e45f-4d6d-a93d-be7ae18f74a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1549 microversion: 2.1 time: 0.283882 Feb 17 04:35:00.521848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 73/148] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:00 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1549 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:00.547805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:00.548351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:00.557653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.558081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.558934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.559483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.747317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7a9ef223-a7f6-48e3-b388-9683aec02006 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204055 Feb 17 04:35:00.748020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 74/149] 10.222.0.73 () {58 vars in 1265 bytes} [Wed Feb 17 04:35:00 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:35:00.753456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:00.754456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:00.766349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.776938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.776938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.776938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:01.041137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:01.056538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c754bf63-e487-4cc1-bc46-ce6ab01a4ba8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.306958 Feb 17 04:35:01.057587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 75/150] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:00 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:01.065294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:01.066132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:01.075625 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:01.076243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:01.077116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:01.077610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:01.354657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:01.370389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6ce704df-85fd-4b93-a278-2936f9e8b36a tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 0.310825 Feb 17 04:35:01.371126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 76/151] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:01 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:01.946423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-44645a74-b6a9-40fb-91dc-29982526530e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 14 microversion: 2.20 time: 2.654726 Feb 17 04:35:01.947572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 76/152] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:34:59 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 14 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:02.075340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:02.076462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:02.086427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.087117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.091634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.091634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.389917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:02.390682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:02.406654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.407453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.408523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.409170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.460154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:02.468746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9ab503e4-01a3-4c41-b5de-e1f20a98853c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.398194 Feb 17 04:35:02.469959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 77/153] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:02 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:02.475688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-4f5a6792-bb3c-4626-bf26-ff035534ead9 req-db2cb025-2a99-4692-b731-b76e8eb20267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f38d61-fed7-40f6-9cd5-0d9c3ffc6437", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8c2c09-fc54-44db-900d-60ab887f70b2"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:02.477863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:02.477863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:35:02.489391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-4f5a6792-bb3c-4626-bf26-ff035534ead9 req-db2cb025-2a99-4692-b731-b76e8eb20267 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.490211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-4f5a6792-bb3c-4626-bf26-ff035534ead9 req-db2cb025-2a99-4692-b731-b76e8eb20267 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.552525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-4f5a6792-bb3c-4626-bf26-ff035534ead9 req-db2cb025-2a99-4692-b731-b76e8eb20267 service nova] Creating event network-vif-unplugged:3e8c2c09-fc54-44db-900d-60ab887f70b2 for instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 on hv-cinder-75995 Feb 17 04:35:02.574283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-4f5a6792-bb3c-4626-bf26-ff035534ead9 req-db2cb025-2a99-4692-b731-b76e8eb20267 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102368 Feb 17 04:35:02.576205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 78/154] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:02.962236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:02.964303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:02.995070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.997514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.998716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:03.001352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:03.149771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0e2a55f8-b68b-4b3d-b409-4e0702d9362e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 14 microversion: 2.20 time: 0.194836 Feb 17 04:35:03.150622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 79/155] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:02 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:03.495873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:03.497238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:03.512127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:03.513127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:03.514787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:03.524035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:03.598308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:03.630928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b34ad790-9fb7-4627-b290-a2d825792867 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 1.244699 Feb 17 04:35:03.631862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 77/156] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:02 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:03.963198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:03.977317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d839f88-3368-4358-8d29-9c7a55fd2c1f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.486403 Feb 17 04:35:03.978187 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 80/157] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:03 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:04.169918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:04.172523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:04.192252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:04.197154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:04.199229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:04.200286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:04.336529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cf62ff55-7f5c-4732-8a10-2ee332b58874 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 14 microversion: 2.20 time: 0.177162 Feb 17 04:35:04.337407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 78/158] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:04 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:04.651347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:04.653284 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:04.666008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:04.666906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:04.668812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:04.670530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:04.960669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:04.972397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-92301fde-95a1-46ab-b17b-7beb03e98997 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1554 microversion: 2.1 time: 0.326491 Feb 17 04:35:04.973271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 81/159] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:04 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1554 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:04.997799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:04.998588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:05.008548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.009287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.010403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.011731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.251004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:05.252258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:05.263955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.264613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.265763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.266547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.416418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d4294a83-67ca-4f62-847c-73da85f063dc tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.169156 Feb 17 04:35:05.420036 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 82/160] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:05 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:35:05.426292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-71b9828e-0b83-436e-866c-3150a5c50ae6 req-49852152-3fa1-46ae-aa57-cfc63396e354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe67c43f-82ea-4944-a563-9fed39d42080", "tag": "7c039b81-545d-4b96-8225-5c9d5bbd4f40"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:05.428785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:05.428785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:35:05.442745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-71b9828e-0b83-436e-866c-3150a5c50ae6 req-49852152-3fa1-46ae-aa57-cfc63396e354 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.443494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-71b9828e-0b83-436e-866c-3150a5c50ae6 req-49852152-3fa1-46ae-aa57-cfc63396e354 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.466969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-71b9828e-0b83-436e-866c-3150a5c50ae6 req-49852152-3fa1-46ae-aa57-cfc63396e354 service nova] Creating event network-changed:7c039b81-545d-4b96-8225-5c9d5bbd4f40 for instance fe67c43f-82ea-4944-a563-9fed39d42080 on hv-cinder-75995 Feb 17 04:35:05.474169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-71b9828e-0b83-436e-866c-3150a5c50ae6 req-49852152-3fa1-46ae-aa57-cfc63396e354 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055472 Feb 17 04:35:05.481318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 83/161] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:05.488107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:05.494596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:05.506744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:05.525925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.529319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.531877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.536599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.537857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-02abd7f2-a8fb-4cc1-8639-ad23625ad3f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.539965 Feb 17 04:35:05.539524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 79/162] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:04 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:05.665436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-96423187-82f8-4504-ae07-7b4ef2147bfc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 14 microversion: 2.20 time: 0.181917 Feb 17 04:35:05.671316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 84/163] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:05 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:05.995747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:05.996939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:06.013328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.014735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.016288 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.018090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.298302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9908455ea1044d59213a7a60a7dac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6d6d4d16e4f8291cf32fca2f053ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:06.308436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-64be029f-fac2-4413-9432-a4bc68cf4e57 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 200 len: 1346 microversion: 2.1 time: 0.320767 Feb 17 04:35:06.315931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 80/164] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:05 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 1346 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:06.428481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:06.429973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:06.451494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.452234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.455686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.455686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.560099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:06.561266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:06.583321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.584312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.585496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.586300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.613504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2de53dbc-87f3-486f-a4ad-fb21514aa46b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.189556 Feb 17 04:35:06.614903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 85/165] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:06 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:35:06.679366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:06.680481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:06.713710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.720050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.723602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.723602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.957855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a7e064c9-933e-4d57-9d6d-28e399a22b0c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 14 microversion: 2.20 time: 0.282228 Feb 17 04:35:06.963595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 86/166] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:06 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 14 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:07.316955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:07.327313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:07.328048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d7965cfb-bae6-430f-94fc-11a366e05d65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.773180 Feb 17 04:35:07.328202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:07.329337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 81/167] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:06 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:07.338345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.338919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.339816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.343130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.410934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] HTTP exception thrown: Instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 could not be found. Feb 17 04:35:07.411427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Returning 404 to user: Instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:35:07.412575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-75d5d8d0-b68c-4999-8ca0-dd8ad877f197 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 404 len: 111 microversion: 2.1 time: 0.089500 Feb 17 04:35:07.413175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 87/168] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:07 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:35:07.516173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-1c28c4f9-4f89-440d-816a-9264c4ac468e req-2db6b5ad-b3b1-4413-a7e0-261755c81eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f38d61-fed7-40f6-9cd5-0d9c3ffc6437", "name": "network-vif-deleted", "tag": "3e8c2c09-fc54-44db-900d-60ab887f70b2"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:07.519686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:07.519686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:35:07.531491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-1c28c4f9-4f89-440d-816a-9264c4ac468e req-2db6b5ad-b3b1-4413-a7e0-261755c81eed service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.534015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-1c28c4f9-4f89-440d-816a-9264c4ac468e req-2db6b5ad-b3b1-4413-a7e0-261755c81eed service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.578236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-1c28c4f9-4f89-440d-816a-9264c4ac468e req-2db6b5ad-b3b1-4413-a7e0-261755c81eed service nova] Creating event network-vif-deleted:3e8c2c09-fc54-44db-900d-60ab887f70b2 for instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 on hv-cinder-75995 Feb 17 04:35:07.585921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-1c28c4f9-4f89-440d-816a-9264c4ac468e req-2db6b5ad-b3b1-4413-a7e0-261755c81eed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074668 Feb 17 04:35:07.586721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 82/169] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:35:07.628095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:07.629291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:07.657563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.661150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.662309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.663513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.836068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-123fd731-2060-477d-803d-4d333c684353 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.213734 Feb 17 04:35:07.836733 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 88/170] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:07 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:35:07.971103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:07.972396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:07.981535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.982119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.983050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.983691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:08.109144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d02a2643-249d-41ab-875a-8d424a2efb38 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 1426 microversion: 2.20 time: 0.142303 Feb 17 04:35:08.109844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 83/171] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:07 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 1426 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:35:08.353541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:08.355542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:08.367943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:08.369934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:08.369934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:08.369934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:08.704593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:08.715760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0c984876-bee1-4502-9ec7-08c7d465bfe4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.368183 Feb 17 04:35:08.716308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 89/172] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:08 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:08.853454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:08.854673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:08.864028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:08.864550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:08.865428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:08.869318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:08.989416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-50c9c649-339a-4035-bc6a-05e6a4961d1c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.144622 Feb 17 04:35:08.993150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 84/173] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:08 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:35:09.122693 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:09.124622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:09.135462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.136170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.137074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.137578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.300527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-83ee76d9-ebdb-474c-b6ac-5db513850df9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 12310 microversion: 2.20 time: 0.183371 Feb 17 04:35:09.301309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 90/174] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:09 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 12310 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:09.403180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:09.403872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:09.413145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.413645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.414550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.415087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.474585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] HTTP exception thrown: Instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 could not be found. Feb 17 04:35:09.475255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Returning 404 to user: Instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:35:09.476186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4a8bfd19-cd0a-4271-9a86-42d0d490a166 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "DELETE /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 404 len: 111 microversion: 2.1 time: 0.077481 Feb 17 04:35:09.480610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 85/175] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:35:09 2021] DELETE /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:35:09.487225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:09.488111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] [instance: 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:09.498924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.499549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.500708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.501396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.565521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] HTTP exception thrown: Instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 could not be found. Feb 17 04:35:09.567424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] Returning 404 to user: Instance 10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:35:09.569039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c4844292-12d7-4590-98ce-3b9138c45775 tempest-DeleteServersTestJSON-929711443 tempest-DeleteServersTestJSON-929711443-project] 10.222.0.73 "GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437" status: 404 len: 111 microversion: 2.1 time: 0.086961 Feb 17 04:35:09.569824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 91/176] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:09 2021] GET /compute/v2.1/servers/10f38d61-fed7-40f6-9cd5-0d9c3ffc6437 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:35:09.739271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:09.740182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:09.761155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.764402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.766042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:09.769566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.001431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:10.003527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:10.012915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:10.016211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.020867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:10.023796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.061307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:10.078337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-760bdb03-7f8b-4c57-9b51-d77b5b516612 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.343173 Feb 17 04:35:10.079541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 86/177] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:09 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:10.181039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d29ceed-48a0-4c99-bcbb-57157bad12eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.183471 Feb 17 04:35:10.184967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 92/178] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:09 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:35:10.321368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:10.322691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:10.340640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:10.341500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.343273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:10.344296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.533907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4459a3b5-75c3-481b-ad61-d7401de62a87 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 17861 microversion: 2.20 time: 0.221559 Feb 17 04:35:10.539828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 87/179] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:10 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 17861 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:11.102696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:11.107977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:11.117523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.118037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.118914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.119514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.200275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:11.202238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:11.216077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.216845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.218303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.219162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.372395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c1ec3054-1ff6-4eed-a1d8-a8d7e3c10109 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.182732 Feb 17 04:35:11.377948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 88/180] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:11 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:35:11.550548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:11.551813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:11.566552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.567697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.569428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.570496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.676815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:11.686552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-54615b58-e150-4e79-81e7-7dbb06361310 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.592783 Feb 17 04:35:11.690480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 93/181] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:11 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:11.706805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3dfcb750-ffcd-4dc7-9493-beae41b4f9fa tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 18663 microversion: 2.20 time: 0.162105 Feb 17 04:35:11.707721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 89/182] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:11 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 18663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:12.394739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:12.394739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:12.402955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.403865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.404796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.405468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.526307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cd1d6160-b974-4ac1-aab7-5a16a79e1f57 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14 microversion: 2.1 time: 0.144022 Feb 17 04:35:12.526968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 94/183] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:12 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:35:12.707725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:12.708586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:12.717698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.718533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.719879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.720729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:12.720917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.722041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:12.731234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.731904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.732899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.733412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.892788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9b882988-90d6-4030-b4c9-b27d3a646892 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 20997 microversion: 2.20 time: 0.175894 Feb 17 04:35:12.897307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 95/184] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:12 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 20997 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:12.995671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:13.005451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-909e3242-6b64-4d70-94d5-d3475f5f551e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.302687 Feb 17 04:35:13.006065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 90/185] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:12 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:13.541502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:13.542845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:13.552531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:13.553122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:13.554194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:13.554794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:13.907408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:13.908015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:13.917485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:13.918002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:13.918863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:13.919389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:16.018604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-885be43d-16fa-4b6c-9072-ff5a0a20f2aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 14890 microversion: 2.1 time: 2.480351 Feb 17 04:35:16.022278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 96/186] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:13 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 14890 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:16.036459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:16.038759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:16.041663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a8430053-0a0c-43c3-931d-45dad2dec01f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 24358 microversion: 2.20 time: 2.138831 Feb 17 04:35:16.046677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 91/187] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:13 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 24358 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:16.052847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:16.053683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:16.054648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:16.055553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:16.386080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:16.401260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-28327b67-caf7-4590-98cc-61b85e26c946 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.376566 Feb 17 04:35:16.401892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 97/188] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:16 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:17.041664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:17.054816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:17.056026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:17.059044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:17.066163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.066623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.080398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.085409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.086249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.086722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.088060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.088618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.247773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c497e2fd-9159-480c-a3ed-85ff80d02a83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 18305 microversion: 2.1 time: 0.216567 Feb 17 04:35:17.249196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 92/189] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:17 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 18305 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:17.314559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-91954ab6-bdff-43c6-ad38-7944cd968161 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 25624 microversion: 2.20 time: 0.258444 Feb 17 04:35:17.314559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 98/190] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:17 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 25624 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:17.422611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:17.423453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:17.436875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.438432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.440333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.441232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.754882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:17.764588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d94a7323-3152-4536-b5fa-acffb081939f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.347510 Feb 17 04:35:17.765243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 93/191] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:17 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:18.264037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:18.266042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:18.275772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:18.276659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:18.277612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:18.278190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:18.311133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0399a6e9-a4ec-4cfb-b19a-568653d55b37 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b3c9d8158>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:18.440704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0399a6e9-a4ec-4cfb-b19a-568653d55b37 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8c457316-5170-442a-b487-9568f9aaf3d4" status: 200 len: 350 microversion: 2.1 time: 0.133381 Feb 17 04:35:18.449046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 94/192] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:35:18 2021] GET /compute/v2.1/os-volumes/8c457316-5170-442a-b487-9568f9aaf3d4 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:18.456281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:18.457644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:18.467172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:18.468081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:18.469668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:18.470448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:21.191503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6acb48ec-74f9-4166-82ae-460e282354f6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 27597 microversion: 2.20 time: 2.740120 Feb 17 04:35:21.196300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 95/193] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:18 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 27597 bytes in 2742 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:21.198019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:21.198905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:21.209043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:21.209579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:21.210481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:21.210981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:21.217348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9cabaf76-6e49-4d36-bd57-98f01b00da99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 23222 microversion: 2.1 time: 2.958042 Feb 17 04:35:21.218385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 99/194] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:18 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 23222 bytes in 2961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:21.505020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:21.532491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6a455618-4f95-4405-9fe3-5d2315c587e2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.333064 Feb 17 04:35:21.532491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 96/195] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:21 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:21.594017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c255a052-8633-4a1c-8151-1702dcef4d1c tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2fdbf6a8>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:21.717467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c255a052-8633-4a1c-8151-1702dcef4d1c tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/875cb1ff-29dc-487a-988f-eb065aeefd73" status: 200 len: 349 microversion: 2.1 time: 0.127820 Feb 17 04:35:21.718318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 100/196] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:35:21 2021] GET /compute/v2.1/os-volumes/875cb1ff-29dc-487a-988f-eb065aeefd73 => generated 349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:22.204551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:22.205628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:22.215117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.215643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.216710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.217389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.231999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:22.233566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:22.249123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.249639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.250715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.251947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.458145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5db5952b-c999-4b33-b3a7-c9183d522995 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 27847 microversion: 2.20 time: 0.243666 Feb 17 04:35:22.458145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 97/197] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:22 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 27847 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:22.482454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-60010422-a19a-4e76-aa14-e1f13d6f7fdb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 24478 microversion: 2.1 time: 0.254142 Feb 17 04:35:22.486626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 101/198] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:22 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 24478 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:22.550872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:22.551819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:22.560974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.561501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.569134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.569788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.847184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:22.851384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c6473342-53b3-408a-b6f5-e8d2bc400d51 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.305510 Feb 17 04:35:22.852233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 98/199] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:22 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:23.474578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:23.478520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:23.494845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:23.496053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:23.515825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.516428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.519618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.520206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.520725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.524061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.531855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.531855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.754343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0a910cfa-4529-40cf-997a-f8fb37b34fc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28207 microversion: 2.20 time: 0.290101 Feb 17 04:35:23.755767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 102/200] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:23 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28207 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:23.796527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d983c83e-0ec9-4149-832b-a7f9bb3e6db0 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2fdbf268>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:23.826716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-16863ab2-1693-473a-89d5-6c300c572a1d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 25883 microversion: 2.1 time: 0.335787 Feb 17 04:35:23.835744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 99/201] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:23 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 25883 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:23.872378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:23.873310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:23.883127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.883869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.884742 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.885310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.156771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:24.168495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6c3107bb-b519-4453-82bb-28dc49a269dc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.302125 Feb 17 04:35:24.169859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 100/202] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:23 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:24.270903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d983c83e-0ec9-4149-832b-a7f9bb3e6db0 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/40100fd9-b3e8-4e22-90b2-96ffa63de5a8" status: 200 len: 350 microversion: 2.1 time: 0.479155 Feb 17 04:35:24.271883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 103/203] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:35:23 2021] GET /compute/v2.1/os-volumes/40100fd9-b3e8-4e22-90b2-96ffa63de5a8 => generated 350 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:24.285077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b8c55c5e-b29e-444c-b4de-44bd64d06241 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b3c9d8d08>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:24.778766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:24.780057 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:24.789570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.790520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.791414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.791916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.899914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d037b253-b6a8-423b-bbd4-3c33d1236524 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28207 microversion: 2.20 time: 0.125035 Feb 17 04:35:24.900628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 104/204] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:24 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28207 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:24.906285 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:24.907990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:24.916665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.917173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.918019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.918518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.046051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-edb7ce72-1d11-42a2-9afd-f4805ae76f92 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 26892 microversion: 2.1 time: 0.143667 Feb 17 04:35:25.046900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 105/205] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:24 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 26892 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:25.197213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:25.198690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:25.210375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.211350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.212401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.213281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.387888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b8c55c5e-b29e-444c-b4de-44bd64d06241 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 1.107269 Feb 17 04:35:25.388616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 101/206] 10.222.0.73 () {58 vars in 1124 bytes} [Wed Feb 17 04:35:24 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:25.407440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ac2db192-81ef-4c14-8816-928e1b5fce0a tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2feb4400>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:25.490806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:25.501833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-744ab7dd-bd67-4f74-a88e-69f629d48a8f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.316042 Feb 17 04:35:25.502476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 106/207] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:25 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:25.705161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ac2db192-81ef-4c14-8816-928e1b5fce0a tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.305374 Feb 17 04:35:25.707118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 102/208] 10.222.0.73 () {58 vars in 1139 bytes} [Wed Feb 17 04:35:25 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:35:25.727514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-575594a6-a47c-4984-b0fe-1eef30490998 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2fdbf1e0>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:25.908993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-575594a6-a47c-4984-b0fe-1eef30490998 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.186020 Feb 17 04:35:25.909870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 107/209] 10.222.0.73 () {58 vars in 1124 bytes} [Wed Feb 17 04:35:25 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:25.925781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:25.927073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:25.936817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.937727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.939799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.940462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.949470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-39510e05-d870-41b8-9029-adfd1454edb1 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2fdbf620>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:26.079472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-39510e05-d870-41b8-9029-adfd1454edb1 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.152593 Feb 17 04:35:26.080635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 108/210] 10.222.0.73 () {58 vars in 1157 bytes} [Wed Feb 17 04:35:25 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:26.086774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:26.092885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-875c27ca-8cb8-4dc2-8cdc-0a4f59ab61f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28498 microversion: 2.20 time: 0.170166 Feb 17 04:35:26.092885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 103/211] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:25 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:26.093546 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:26.099293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:26.108264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8fb3694f-b0d4-47fd-915e-6a6d81a755ee tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2feb4e18>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:26.111908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.113015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:26.113530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.246554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8fb3694f-b0d4-47fd-915e-6a6d81a755ee tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.144769 Feb 17 04:35:26.247184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 104/212] 10.222.0.73 () {58 vars in 1160 bytes} [Wed Feb 17 04:35:26 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:26.261476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a738954b-f31f-4426-8df6-1735ecad8f22 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2fe39048>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:26.269838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fea6fe3e-92fd-4d9e-8160-5aa6508ecb72 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 27435 microversion: 2.1 time: 0.187384 Feb 17 04:35:26.271050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 109/213] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:26 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 27435 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:26.369880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a738954b-f31f-4426-8df6-1735ecad8f22 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.112557 Feb 17 04:35:26.370792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 105/214] 10.222.0.73 () {58 vars in 1145 bytes} [Wed Feb 17 04:35:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:26.385231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8d82988b-d149-4da0-ae8c-220fd0044568 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b3c9886a8>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:26.485752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8d82988b-d149-4da0-ae8c-220fd0044568 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.105044 Feb 17 04:35:26.486415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 110/215] 10.222.0.73 () {58 vars in 1178 bytes} [Wed Feb 17 04:35:26 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:26.502340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4ca330d7-5b51-4683-98a0-df749b989bf4 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] Calling method '.version_select at 0x7f9b2fe39598>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:26.525772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:26.527045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:26.539266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:26.540028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.541043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:26.541713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.618511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4ca330d7-5b51-4683-98a0-df749b989bf4 tempest-VolumesTestJSON-1044129996 tempest-VolumesTestJSON-1044129996-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.120626 Feb 17 04:35:26.618511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 106/216] 10.222.0.73 () {58 vars in 1145 bytes} [Wed Feb 17 04:35:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:26.940091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:26.949634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9ae763c9-3fe8-4823-b422-cc5fca782cd1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.431498 Feb 17 04:35:26.964019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 111/217] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:26 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:27.102505 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:27.104268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:27.121811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.122326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.123185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.125256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.275887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-07e48b43-8e0e-4eab-bec6-f669ffe738af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28560 microversion: 2.20 time: 0.178145 Feb 17 04:35:27.276588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 107/218] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:27 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:27.283491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:27.284575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:27.297514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.298567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.299461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.300061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.434461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dba7cb0d-797d-4afb-bd95-a368eebf3fd3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 27690 microversion: 2.1 time: 0.155243 Feb 17 04:35:27.435846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 112/219] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:27 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 27690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:27.972148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:27.973085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:27.982599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.983117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.984000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.984553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.278116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:28.288631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-79ad40ad-1b90-4f1e-bdf5-c8ac0b80f454 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.321858 Feb 17 04:35:28.289909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 108/220] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:27 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:28.292308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:28.293795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:28.305686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.306201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.307062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.307607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.448007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:28.449276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:28.457631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-425b09a4-9f74-4ca2-833b-174bf627f684 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28666 microversion: 2.20 time: 0.170408 Feb 17 04:35:28.465739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 113/221] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:28 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:28.466176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.466176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.466176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.466176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.629267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ed0e8b49-e17c-4546-bb5a-45f98cadb367 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 27868 microversion: 2.1 time: 0.184510 Feb 17 04:35:28.631353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 109/222] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:28 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 27868 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:35:29.311204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:29.312378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:29.322250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.322893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.323820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.324324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.471821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:29.473358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:29.493486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.493976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.498573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.499744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.580294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:29.604404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-02e4ba91-530e-4d5d-a4f2-c981d07bdec7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1522 microversion: 2.1 time: 0.299367 Feb 17 04:35:29.605413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 114/223] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:29 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:29.652146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:29.653820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:29.684619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.685613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.692227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.698223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.008331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-09846c8b-2fe8-4645-a379-f55f56ba8151 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28165 microversion: 2.1 time: 0.368781 Feb 17 04:35:30.009784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 115/224] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:29 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28165 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:30.029293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d228a930-3411-4add-8179-754c37928fb4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28666 microversion: 2.20 time: 0.562446 Feb 17 04:35:30.031330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 110/225] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:29 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28666 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:30.627323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:30.628270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:30.637492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:30.638134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.639014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:30.639554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.936699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:30.953101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a81f0d4d-b027-4536-a3e1-3632e25f0749 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1502 microversion: 2.1 time: 0.332713 Feb 17 04:35:30.954674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 116/226] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:30 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:30.972113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:30.973196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:30.982511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:30.983430 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.984564 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:30.985808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.034855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:31.043542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:31.053149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.053944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.055024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.055782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.207150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-90b2ae8b-6d98-4079-9940-34befe17c92f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28292 microversion: 2.1 time: 0.176321 Feb 17 04:35:31.209047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 117/227] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:31 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:31.219467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:31.221324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:31.233853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.234383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.235863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.238413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.414358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5ca62a82-069d-4ea0-9ee6-cdca1fa799a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28666 microversion: 2.20 time: 0.203516 Feb 17 04:35:31.421884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 118/228] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:31 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:31.452702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:31.486185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1ab1b659-3d76-4eb1-8511-8aa644229ea8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1517 microversion: 2.1 time: 0.517540 Feb 17 04:35:31.486994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 111/229] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:30 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1517 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:32.233740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:32.236295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:32.261249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.261776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.264775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.265359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.430376 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:32.441226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:32.462311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.462833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.463755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.464257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.582383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-81693e3f-b3d7-48c8-ac59-96d455651120 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28456 microversion: 2.1 time: 0.356439 Feb 17 04:35:32.586968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 119/230] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:32 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28456 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:32.771745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-30b24054-119f-495b-aea1-e4412e138bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 28818 microversion: 2.20 time: 0.345317 Feb 17 04:35:32.775920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 112/231] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:32 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 28818 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:33.597790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:33.599013 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:33.615516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.616031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.616882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.617353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.795194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:33.795194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:33.811763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.812284 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.813692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.814190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.850628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5394cdcd-8a23-41b1-8d8b-1d4ec0d17b21 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28624 microversion: 2.1 time: 0.259320 Feb 17 04:35:33.851783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 120/232] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:33 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28624 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:35:33.858835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:33.861021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:33.872642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.874070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.875127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.876622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.968240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lazy-loading 'flavor' on Instance uuid 2641c971-9a8a-467c-92f1-1317f397e36f {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:35:34.057526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-393ea0aa-ca67-4a63-b2f3-868e8207162f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 30562 microversion: 2.20 time: 0.272188 Feb 17 04:35:34.058254 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 113/233] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:33 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 30562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:34.655819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ee88524c-df38-4c32-807e-11ed36bbf665 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action" status: 200 len: 32 microversion: 2.1 time: 0.801862 Feb 17 04:35:34.657501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 121/234] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:33 2021] POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action => generated 32 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:35:34.676817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:34.677986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:34.688441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.689566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.691039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.691763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.865154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:34.866109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:34.900178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.900691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.901558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.902054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:35.057772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-53b8ff81-26fc-404d-9a1d-5a222cbb0e24 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28624 microversion: 2.1 time: 0.197469 Feb 17 04:35:35.058959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 122/235] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:34 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28624 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:35:35.084755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:35.084755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:35.102289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:35.103071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:35.104139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:35.104968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:35.298598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0a23f76a-9104-4e73-9364-5bbcbc0e79b1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 31715 microversion: 2.20 time: 0.227024 Feb 17 04:35:35.298598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 123/236] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:35 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 31715 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:35.491992 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:35.518714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-23be541a-875e-460a-8407-cfd3aa90a303 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.832567 Feb 17 04:35:35.518714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 114/237] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:34 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:36.074368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:36.076390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:36.086404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.087272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.088235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.088802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.286167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9d024d8a-633d-4c70-b8da-fccf7070a1c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28624 microversion: 2.1 time: 0.215793 Feb 17 04:35:36.288291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 124/238] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:36 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28624 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:36.318575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:36.321670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:36.342290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.343177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.344790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.345681 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.496057 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d5b2c381-e4c1-4fe3-84fb-c212f02221d7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 32748 microversion: 2.20 time: 0.188949 Feb 17 04:35:36.497549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 115/239] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:36 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 32748 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:36.530973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:36.530973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:36.539787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.540299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.541166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.541659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.803532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:36.812896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f5368a55-3045-484c-ad31-88ea3b0b4370 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.287488 Feb 17 04:35:36.813921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 125/240] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:36 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:37.303475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:37.306332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:37.318712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.319208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.320269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.320816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.343616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-218762297", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "b3751aa1-d0d2-4655-997c-f8c5fd944ed5"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:37.415872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] validate_networks() for [('b3751aa1-d0d2-4655-997c-f8c5fd944ed5', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:35:37.434033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-14e99572-e331-4ac2-a357-62b50cb74728 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28624 microversion: 2.1 time: 0.138950 Feb 17 04:35:37.434858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 116/241] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:37 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28624 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:37.512374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:37.513988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:37.522619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.523113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.524183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.524682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.670522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a3b82830-74cd-4fb6-99a6-3cdebf3780a9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 33462 microversion: 2.20 time: 0.163616 Feb 17 04:35:37.675494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 117/242] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:37 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 33462 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:37.833881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:37.834575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:37.845000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.845511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.846418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.846920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.229671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:35:38.230635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:35:38.231793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:35:38.232743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:35:38.233218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:35:38.243884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.244432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.245332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.245835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.268753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Getting quotas for project dd5defbe82e641678f7511f3f14fefbf. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:35:38.285579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Getting quotas for user 980b70ffb35940bea61a77850e703190 and project dd5defbe82e641678f7511f3f14fefbf. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:35:38.292767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:38.319186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c8277538-ad77-475b-938e-af8b6f57be5e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.490599 Feb 17 04:35:38.319842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 118/243] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:37 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:38.321647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:35:38.331795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:35:38.446604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:38.448106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:38.460405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.460405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.460405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.460405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.494171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-96995b48-77ed-49eb-b84e-41e586285410 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155065 Feb 17 04:35:38.494983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 126/244] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:35:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:35:38.507653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-67d86609-513f-4573-a21f-3b1436eaa1a1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:38.511481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-67d86609-513f-4573-a21f-3b1436eaa1a1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:38.619154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-67d86609-513f-4573-a21f-3b1436eaa1a1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:38.629465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-67d86609-513f-4573-a21f-3b1436eaa1a1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1213 microversion: 2.1 time: 0.126301 Feb 17 04:35:38.630062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 127/245] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:38 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:38.649504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7b6662e8-da5f-4c5a-bb63-4c21d477819b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 28956 microversion: 2.1 time: 0.206213 Feb 17 04:35:38.655689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 119/246] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:38 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 28956 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:35:38.688401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:38.689727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:38.702701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.703404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.704437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.705141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.848138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c89a7bb2-ab5b-4e51-aa26-5ab0dc32eaff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 34049 microversion: 2.20 time: 0.164174 Feb 17 04:35:38.848973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 128/247] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:38 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 34049 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:39.340786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:39.342211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:39.351492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.352025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.352887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.353394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.652847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dbaf83f1-8b1f-49f0-b495-65b95a8aa2ce tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:39.658126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dbaf83f1-8b1f-49f0-b495-65b95a8aa2ce tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:39.762753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:39.767702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dbaf83f1-8b1f-49f0-b495-65b95a8aa2ce tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:39.775875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dbaf83f1-8b1f-49f0-b495-65b95a8aa2ce tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1213 microversion: 2.1 time: 0.127129 Feb 17 04:35:39.776675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-670ade73-96d8-4d7a-94b8-f00fecfa788d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.441881 Feb 17 04:35:39.776815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 129/248] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:39 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:39.778095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 120/249] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:39 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:39.781973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:39.790712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:39.792437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.792956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.793824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.794592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.861931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:39.863185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:39.874383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.875761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.876838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.877316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.927231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-01ff0d7a-a19e-41be-a80e-9c97a093c03d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 30779 microversion: 2.1 time: 0.148986 Feb 17 04:35:39.929041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 130/250] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:39 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 30779 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:40.015195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c6a9a421-343b-4c47-b709-5501e746f752 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 34744 microversion: 2.20 time: 0.158087 Feb 17 04:35:40.016373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 121/251] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:39 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 34744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:40.796063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:40.797435 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:40.809691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.809691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.809691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.810096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.816492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:40.817659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:40.830496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.831340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.832907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.834112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.007451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:41.018060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7785fff5-2410-436c-a204-78f04aacbcde tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1209 microversion: 2.1 time: 0.227647 Feb 17 04:35:41.018698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 131/252] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:40 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:41.034613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:41.039885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:41.049594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.050608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.052230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.053228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.122911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:41.134304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e0e63f76-42a8-4a14-b198-f1068b577911 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.330406 Feb 17 04:35:41.145375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 122/253] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:40 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:41.146673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:41.149041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:41.157424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.158091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.158972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.159500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.924857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d1eb6025-87f2-4fbe-867c-5d3d30a02bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 37901 microversion: 2.20 time: 2.783534 Feb 17 04:35:43.927095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 123/254] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:41 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 37901 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:43.936723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:43.938793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:43.941781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2cef751f-4d25-4298-8d26-cfa55523fe78 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 33476 microversion: 2.1 time: 2.921667 Feb 17 04:35:43.942927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 132/255] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:41 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 33476 bytes in 2924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:43.948676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:43.949452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:43.950407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.951078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.952550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.953058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.970544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.973016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.976636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.979090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.242821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:44.256506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-76269b6a-ace3-4fec-a794-19fb209de60f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1265 microversion: 2.1 time: 0.325088 Feb 17 04:35:44.256506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 124/256] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:43 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:44.318143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:44.330566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-38c8e41c-9f3b-45ed-91d8-72b3d9b343cc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.386213 Feb 17 04:35:44.331507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 133/257] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:43 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:44.940147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:44.941315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:44.950202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.950807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.951709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.952210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.957709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:44.958766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:44.967825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.968331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.969464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.969919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.144791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cf4a2c28-5ad9-4975-bd80-b406f9073b9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 38210 microversion: 2.20 time: 0.209317 Feb 17 04:35:45.146044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 125/258] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:44 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 38210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:45.177764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d34f51f5-6944-491b-aa07-aaab3d3cc4b1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 34098 microversion: 2.1 time: 0.224707 Feb 17 04:35:45.178499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 134/259] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:44 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 34098 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:45.275832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:45.277521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:45.288318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.288911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.289911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.290495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.359970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:45.364244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:45.372548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.373122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.374201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.374708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.532519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:45.552524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ccc7a261-3e10-44b3-9a7d-dedab4210c19 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1271 microversion: 2.1 time: 0.278562 Feb 17 04:35:45.553861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 126/260] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:45 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:45.912417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:45.929658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e1e13830-4956-4495-853b-3099bc93f9d1 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.577831 Feb 17 04:35:45.930804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 135/261] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:45 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:46.159929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:46.160985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:46.188439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.189086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.190917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.192544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.195802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:46.196925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:46.214818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.222744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.224662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.225332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.410830 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5369736f-d01d-4fc5-aeba-77e825d30ba8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 34871 microversion: 2.1 time: 0.220683 Feb 17 04:35:46.411831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 136/262] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:46 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 34871 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:46.421951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0ba21b8b-49b3-49f7-8fae-0e0e5be63866 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 38210 microversion: 2.20 time: 0.266752 Feb 17 04:35:46.422648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 127/263] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:46 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 38210 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:46.575223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:46.580514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:46.612273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.613129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.614209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.614939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.953871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:46.955074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:46.970039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.970803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.972394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.974381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.123366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:47.151777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6f13ce92-c47b-4cfe-a710-cda86f14ff16 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1313 microversion: 2.1 time: 0.563440 Feb 17 04:35:47.152765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 137/264] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:46 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:47.306484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:47.316678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5b7ca98a-95a6-41aa-ac1f-469a3244a005 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.371733 Feb 17 04:35:47.317718 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 128/265] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:46 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:47.427829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:47.435106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:47.436189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:47.444149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:47.457415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.457619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.458400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.460079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.461249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.461897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.473822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.473822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.658111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d964e87d-edf8-47a3-a7ca-2186e19263ac tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 35729 microversion: 2.1 time: 0.235128 Feb 17 04:35:47.658898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 138/266] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:47 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 35729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:47.676944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-951c1afd-60ee-43cf-8583-00591ce2e4ef tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 200 len: 38351 microversion: 2.20 time: 0.244260 Feb 17 04:35:47.677400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 129/267] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:47 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 38351 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:47.697566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:47.698262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:47.720417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.725151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.726246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.728562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.969391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d3e8ef0c-0903-400d-aa1d-0a9db58438f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/ips" status: 200 len: 152 microversion: 2.20 time: 0.275573 Feb 17 04:35:47.970424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 139/268] 10.222.0.73 () {60 vars in 1279 bytes} [Wed Feb 17 04:35:47 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/ips => generated 152 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:48.175875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:48.178054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:48.207027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.209673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.209673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.210421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.337453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:48.338281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:48.358112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.359048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.360510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.367336 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.049898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:49.065583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-18530edf-d705-4931-8fae-6c8c64ef56c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.733015 Feb 17 04:35:49.066975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 140/269] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:48 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:49.085160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:49.087786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:49.111959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.112896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.114066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.114915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.288362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f9b3bc60-0af0-4fc1-80a8-c02c52a86685 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 37358 microversion: 2.1 time: 0.211200 Feb 17 04:35:49.288362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 141/270] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:49 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 37358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:50.056305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:50.067870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-33ac1064-3025-425f-b7ac-9755e7fabf86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1313 microversion: 2.1 time: 1.900048 Feb 17 04:35:50.068465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 130/271] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:48 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1313 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:50.088768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:50.091931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:50.100785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.101298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.106240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.106240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.207573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-a67fa58b-6de2-4810-9891-97473f171799 req-e8b8f8e9-c166-437b-be97-71f541ee29f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31271362-17cd-4782-b4db-fc1ad9f22959", "tag": "bc6e60c3-9adb-4056-8896-29a40f624a25"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:50.209251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:50.209251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:35:50.219326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a67fa58b-6de2-4810-9891-97473f171799 req-e8b8f8e9-c166-437b-be97-71f541ee29f7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.220113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a67fa58b-6de2-4810-9891-97473f171799 req-e8b8f8e9-c166-437b-be97-71f541ee29f7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.239135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-a67fa58b-6de2-4810-9891-97473f171799 req-e8b8f8e9-c166-437b-be97-71f541ee29f7 service nova] Creating event network-changed:bc6e60c3-9adb-4056-8896-29a40f624a25 for instance 31271362-17cd-4782-b4db-fc1ad9f22959 on hv-cinder-75995 Feb 17 04:35:50.245607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-a67fa58b-6de2-4810-9891-97473f171799 req-e8b8f8e9-c166-437b-be97-71f541ee29f7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042264 Feb 17 04:35:50.247601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 131/272] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:50.306100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:50.312055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:50.335198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.336010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.339349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.340054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.537326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-62624a36-8a30-46e2-96f2-b789ef354aa1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 38142 microversion: 2.1 time: 0.240520 Feb 17 04:35:50.544769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 132/273] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:50 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 38142 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:50.962565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:50.987752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-def9e27a-8ad2-4b8f-898e-190399b1d11d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.903465 Feb 17 04:35:50.988659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 142/274] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:50 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:51.091637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:51.093047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:51.109274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:51.111077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:51.112153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:51.112783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:51.474933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:51.475873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:51.491173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:51.500567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:51.501542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:51.502053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:51.660063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lazy-loading 'flavor' on Instance uuid a076d3cd-b9c1-4802-bdae-3941d4348e7c {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:35:51.896241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:51.917928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d3095306-614f-4eba-ac0d-4a1e1bdad438 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1313 microversion: 2.1 time: 0.826848 Feb 17 04:35:51.918829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 133/275] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:51 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1313 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:51.931396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:51.935211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:51.958908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:51.964284 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:51.964284 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:51.964284 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.113509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-acf838f3-2f9f-4f4e-979b-b183a03c61b9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 38142 microversion: 2.1 time: 0.192014 Feb 17 04:35:52.114636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 134/276] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:51 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 38142 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:52.153751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:52.157674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:52.187566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.205842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.208969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.211273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.582851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:52.594696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cc92b188-265b-4096-bbbe-9e39d182d9ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1503 microversion: 2.1 time: 0.460186 Feb 17 04:35:52.595263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 135/277] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:52 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1503 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:52.618423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12fd2032-d158-419f-9391-b1907405d3b5"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:52.621501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:52.658283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.658807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.659759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.660507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.788681 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] HTTP exception thrown: Cannot 'attach_volume' instance 2641c971-9a8a-467c-92f1-1317f397e36f while it is in vm_state rescued Feb 17 04:35:52.789500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Returning 409 to user: Cannot 'attach_volume' instance 2641c971-9a8a-467c-92f1-1317f397e36f while it is in vm_state rescued {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:35:52.795192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f4cdd189-5b30-4b55-a28c-d81740af58e0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.178169 Feb 17 04:35:52.795192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 136/278] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:35:52 2021] POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 17 04:35:52.801900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:52.802500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:52.811723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9d8a6d08-0319-4da7-87e9-0ba1e462dbf1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 202 len: 0 microversion: 2.20 time: 1.342428 Feb 17 04:35:52.812794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.813311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.817731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.817731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.819178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 143/279] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:51 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 0 bytes in 1346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:35:52.841662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:52.841662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:52.861456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.862140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.867985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.868663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.397244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:53.407852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:53.409564 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:53.410923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f7a545d8-1aa7-4558-ac84-64cf4f2bb0cf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.586574 Feb 17 04:35:53.424876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 144/280] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:35:52 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:35:53.424876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:53.424876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:53.428314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.428845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.430237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.430758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.451642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0ad01a6b-a4ff-438b-b3f3-17127c41ee88 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action" status: 202 len: 0 microversion: 2.1 time: 0.654334 Feb 17 04:35:53.456576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 137/281] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:52 2021] POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:53.463181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:53.464385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:53.493163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.498757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.501071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.501813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.659464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d1e2bb8-ed63-464f-8bf6-0b5571d83673 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 200 len: 38273 microversion: 2.1 time: 0.202924 Feb 17 04:35:53.661025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 138/282] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:35:53 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 38273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:35:53.673398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:53.677366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:53.696935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.699948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.701199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.704080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.047533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:54.077780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-42343d66-7d2f-41fd-a1a7-944da4553fd1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1313 microversion: 2.1 time: 0.664994 Feb 17 04:35:54.082830 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 145/283] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:53 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:54.094177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:54.095725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:54.106744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:54.107886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.110377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:54.112031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.222876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-18dd1246-4f7f-4093-872c-928eb1669419 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/ips" status: 200 len: 146 microversion: 2.1 time: 0.137694 Feb 17 04:35:54.223065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 146/284] 10.222.0.73 () {58 vars in 1238 bytes} [Wed Feb 17 04:35:54 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/ips => generated 146 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:54.407148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:54.418683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b04ace7e-8649-4f48-ae80-3b907b904782 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1511 microversion: 2.1 time: 0.755930 Feb 17 04:35:54.438926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:54.439636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:54.444744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 139/285] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:53 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1511 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:54.448155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:54.448673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.449534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:54.450028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.927565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:54.947112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:54.951130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:54.956536 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d8719440-4f99-4df1-bbb4-f78a376c2d5f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.521276 Feb 17 04:35:54.962648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 147/286] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:35:54 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:35:55.096720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:55.097510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:55.108402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.109502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.110797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.111345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.440594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:55.441847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:55.464580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.465722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.467771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.470261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.978908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:55.991744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0f9e897f-dd28-4c72-972d-a2c9e10addab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1313 microversion: 2.1 time: 0.899032 Feb 17 04:35:55.992984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 140/287] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:55 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1313 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:56.005097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-a57e157a-bc21-4cd8-af62-4382ee4c2c27 req-c3962f8c-b266-44fd-9b4c-4c64fb41c368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31271362-17cd-4782-b4db-fc1ad9f22959", "name": "network-vif-plugged", "status": "completed", "tag": "bc6e60c3-9adb-4056-8896-29a40f624a25"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:56.009984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:56.009984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:35:56.031631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a57e157a-bc21-4cd8-af62-4382ee4c2c27 req-c3962f8c-b266-44fd-9b4c-4c64fb41c368 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.032165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a57e157a-bc21-4cd8-af62-4382ee4c2c27 req-c3962f8c-b266-44fd-9b4c-4c64fb41c368 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.073034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-a57e157a-bc21-4cd8-af62-4382ee4c2c27 req-c3962f8c-b266-44fd-9b4c-4c64fb41c368 service nova] Creating event network-vif-plugged:bc6e60c3-9adb-4056-8896-29a40f624a25 for instance 31271362-17cd-4782-b4db-fc1ad9f22959 on hv-cinder-75995 Feb 17 04:35:56.103429 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-a57e157a-bc21-4cd8-af62-4382ee4c2c27 req-c3962f8c-b266-44fd-9b4c-4c64fb41c368 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108446 Feb 17 04:35:56.104393 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 141/288] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:56.116170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:56.121810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:56.148810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.149556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.150600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.156085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.480012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:56.505816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a8f4d2e5-5d73-4445-ae24-f5e4162d28f5 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1511 microversion: 2.1 time: 1.069932 Feb 17 04:35:56.508728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 148/289] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:55 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1511 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:57.011179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:57.011806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:57.031514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.032039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:57.032921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.033413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:57.252943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:57.288313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:57.291051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:57.295144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dc9d4260-f753-4630-8e0c-569442bec0fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 1.188630 Feb 17 04:35:57.300162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 142/290] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:35:56 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:35:57.535018 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:57.535882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:57.546228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.547701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:57.548802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.549503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:58.035409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:58.065692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1c0eba42-cca6-4ab2-a0d2-c36a6e6558d4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1313 microversion: 2.1 time: 1.059151 Feb 17 04:35:58.066325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 149/291] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:57 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1313 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:58.086632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4979c37f-83b5-4734-a90f-5c0b3e65268e"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:58.098007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:58.121440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:58.122349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:58.123686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:58.124455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:58.125308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:58.139379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-45a94c22-b134-443a-a85b-36fce189c921 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1517 microversion: 2.1 time: 0.608498 Feb 17 04:35:58.140869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 143/292] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:57 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1517 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:58.332952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:58.335268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:58.360808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:58.361945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:58.365150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:58.365856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.014243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:59.025538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:59.032164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:59.035171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-91e6190c-5bb0-44ac-984a-8ea0a090ebcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.709277 Feb 17 04:35:59.037279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 144/293] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:35:58 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:35:59.085566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:59.086251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:59.100839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:59.102487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.113615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:59.116172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.693601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:59.716777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-47cc44e5-cd75-4398-b909-eb45bf3b6b26 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1497 microversion: 2.1 time: 0.634192 Feb 17 04:35:59.736364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 145/294] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:59 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1497 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:00.078137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:00.080739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:00.103561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.105920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.107168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.107861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.447598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:00.470779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:00.473301 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:00.476130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f7083c63-92cc-440d-a5e2-fac86a5185ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.413996 Feb 17 04:36:00.477986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 146/295] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:00 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:36:00.705724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-24b64ed7-19f6-44b7-b01e-0edbd2320b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.628152 Feb 17 04:36:00.706661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 150/296] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:35:58 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/os-volume_attachments => generated 194 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:00.881798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:00.888738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:00.913975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.915329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.916875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.917832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.380493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:01.381269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:01.393843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.394737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.396074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.397489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.505465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:36:01.513706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:01.528679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-565f670b-dac0-4b7b-a356-e58374706f7c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1517 microversion: 2.1 time: 0.654585 Feb 17 04:36:01.538902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 147/297] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:00 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1517 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:01.551920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:01.552544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:01.571235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.571809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.572695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.578348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.873482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3579a04c-ebd6-47ca-8143-bf307ac33e0f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 204 len: 0 microversion: 2.1 time: 0.497896 Feb 17 04:36:01.884899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 151/298] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:36:01 2021] DELETE /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:36:01.893151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d5706be-4fbf-4c60-956b-d0df88b0de96"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:01.901873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:01.918011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.918857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.919949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.920340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.305563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:02.324679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:02.326781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:02.333892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-41893352-2186-456f-ad55-bcb6e19a7e42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.793430 Feb 17 04:36:02.353898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 148/299] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:01 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:02.382082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:02.384016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:02.411144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.412477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.413616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.415907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.053849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:03.075575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f850e0ed-3648-43d1-adf7-b6386c6f4db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1503 microversion: 2.1 time: 0.704762 Feb 17 04:36:03.075575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 149/300] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:02 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1503 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:03.226428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-49f5f375-d5a2-4e39-a855-adf9d1ae3be3 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.349275 Feb 17 04:36:03.227886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 152/301] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:36:01 2021] POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments => generated 194 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:03.359240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:03.360935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:03.387999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.388794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.393562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.398859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.096331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:04.097118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:04.147760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.148642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.158534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.159433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.189496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:04.205415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:04.214822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:04.218905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6d4a10af-1d73-427e-bad2-9fbb96d42db9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.863520 Feb 17 04:36:04.232658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 150/302] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:03 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:05.215826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.243192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-08deb9a8-b348-49b6-b768-0ba9794741ab tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1503 microversion: 2.1 time: 1.154274 Feb 17 04:36:05.245462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:05.246165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:05.257701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 153/303] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:04 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1503 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:05.287023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.287814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.289813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.293214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.760267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-c8acd316-b8cf-4fbf-891e-bd02dff7e6bd req-d01c7829-de3d-42a7-b814-766a3c03a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31271362-17cd-4782-b4db-fc1ad9f22959", "name": "network-vif-unplugged", "status": "completed", "tag": "bc6e60c3-9adb-4056-8896-29a40f624a25"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:05.762471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:05.762471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:05.782477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-c8acd316-b8cf-4fbf-891e-bd02dff7e6bd req-d01c7829-de3d-42a7-b814-766a3c03a81a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.785097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-c8acd316-b8cf-4fbf-891e-bd02dff7e6bd req-d01c7829-de3d-42a7-b814-766a3c03a81a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.863261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-c8acd316-b8cf-4fbf-891e-bd02dff7e6bd req-d01c7829-de3d-42a7-b814-766a3c03a81a service nova] Creating event network-vif-unplugged:bc6e60c3-9adb-4056-8896-29a40f624a25 for instance 31271362-17cd-4782-b4db-fc1ad9f22959 on hv-cinder-75995 Feb 17 04:36:05.883098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-c8acd316-b8cf-4fbf-891e-bd02dff7e6bd req-d01c7829-de3d-42a7-b814-766a3c03a81a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123807 Feb 17 04:36:05.884299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 154/304] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:05.929056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.954336 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.957354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.958827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2fddf159-7b03-4c48-b5f9-5f97ae20ebbd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.718795 Feb 17 04:36:05.959858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 151/305] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:05 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:36:06.278640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:06.279743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:06.307455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:06.308239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:06.309837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:06.311959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:06.822764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:06.851022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8b71a3ca-46f2-4819-b12b-d91857cac5df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1503 microversion: 2.1 time: 0.577071 Feb 17 04:36:06.882112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 155/306] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:06 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1503 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:07.015389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:07.017894 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:07.027913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.028528 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.029872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.031187 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.898048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:07.901434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:07.927762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.928281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.929157 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.929666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.833899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:08.853437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-deeb8965-b392-49c4-a46a-2342e7fe6aa1 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1503 microversion: 2.1 time: 0.956454 Feb 17 04:36:08.854116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 156/307] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:07 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1503 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:09.352124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:09.409322 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:09.416018 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:09.419850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8affd7ee-7655-4243-92ac-3595ecc4120a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 2.443795 Feb 17 04:36:09.429825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 152/308] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:06 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:09.510920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2473fbdb-cfe6-455b-8c37-c2d2a8bed957 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:09.525020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2473fbdb-cfe6-455b-8c37-c2d2a8bed957 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.526607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2473fbdb-cfe6-455b-8c37-c2d2a8bed957 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.537884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-8923a343-ab54-4709-b9d7-a208f82766e7 req-98c64f64-8841-4395-92f4-b244e0753a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31271362-17cd-4782-b4db-fc1ad9f22959", "name": "network-vif-deleted", "tag": "bc6e60c3-9adb-4056-8896-29a40f624a25"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:09.544527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:09.544527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:09.566831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8923a343-ab54-4709-b9d7-a208f82766e7 req-98c64f64-8841-4395-92f4-b244e0753a3a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.567342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8923a343-ab54-4709-b9d7-a208f82766e7 req-98c64f64-8841-4395-92f4-b244e0753a3a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.618933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-8923a343-ab54-4709-b9d7-a208f82766e7 req-98c64f64-8841-4395-92f4-b244e0753a3a service nova] Creating event network-vif-deleted:bc6e60c3-9adb-4056-8896-29a40f624a25 for instance 31271362-17cd-4782-b4db-fc1ad9f22959 on hv-cinder-75995 Feb 17 04:36:09.625756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-8923a343-ab54-4709-b9d7-a208f82766e7 req-98c64f64-8841-4395-92f4-b244e0753a3a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091829 Feb 17 04:36:09.626373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 153/309] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:09.800325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2473fbdb-cfe6-455b-8c37-c2d2a8bed957 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Going to try to stop instance {{(pid=98222) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 04:36:09.875242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:09.875242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:09.895437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.895967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.896879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.897388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.088234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.088809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.089387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lazy-loading 'fault' on Instance uuid 31271362-17cd-4782-b4db-fc1ad9f22959 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:36:10.498131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.504677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2473fbdb-cfe6-455b-8c37-c2d2a8bed957 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 202 len: 0 microversion: 2.1 time: 0.998422 Feb 17 04:36:10.508629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 157/310] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:09 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:10.513804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8589e609-9493-459b-860f-6deb41c38b8c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 200 len: 1303 microversion: 2.1 time: 0.643109 Feb 17 04:36:10.520203 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 154/311] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:09 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 1303 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:10.520981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:10.522059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:10.527009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:10.527726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:10.531765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.532708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.534044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.534700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.564245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.565334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.566736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.567922 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.921103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.922343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.932117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a573cf99-f592-4090-ba6c-898ee91de8e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.410498 Feb 17 04:36:10.932717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 155/312] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:10 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:10.943604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.947854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.949903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-35c6e787-1b95-4c74-98c9-5165feeb7b16 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1744 microversion: 2.20 time: 0.435637 Feb 17 04:36:10.951237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 158/313] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:10 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1744 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:11.539629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:11.550743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 31271362-17cd-4782-b4db-fc1ad9f22959] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:11.573873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.578596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.583471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.583471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.837944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] HTTP exception thrown: Instance 31271362-17cd-4782-b4db-fc1ad9f22959 could not be found. Feb 17 04:36:11.838729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Returning 404 to user: Instance 31271362-17cd-4782-b4db-fc1ad9f22959 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:11.839673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-141cd80a-0b7a-4f5d-9c7c-9915d62d1075 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959" status: 404 len: 111 microversion: 2.1 time: 0.304598 Feb 17 04:36:11.852233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 156/314] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:11 2021] GET /compute/v2.1/servers/31271362-17cd-4782-b4db-fc1ad9f22959 => generated 111 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:36:11.953859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:11.955016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:11.972757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:11.975442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:11.986358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.990849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.993797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.995612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.999080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.999764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.000881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.006839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.423118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:12.434255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ac4d8fbc-d4e3-45e6-9487-ed8ff328340c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.485646 Feb 17 04:36:12.434895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 159/315] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:11 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:12.443404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1375124063", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "b3751aa1-d0d2-4655-997c-f8c5fd944ed5"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:12.620926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:12.632616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:12.634787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:12.638760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a85cae32-e463-4e9e-b95a-96d5e5e58d62 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.670116 Feb 17 04:36:12.640375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 157/316] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:11 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:13.456984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:13.457777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:13.497009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.502847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.503803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.504308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.906810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:13.917753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7934f319-fdcc-4f1d-b0b9-0240ebf67949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.466552 Feb 17 04:36:13.918655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 158/317] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:13 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:13.942217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:13.942890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:13.951327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.951868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.952722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.953209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:14.296970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:14.315806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:14.319647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:14.320928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f203ce41-5f77-48c9-a14c-faa86388c7d2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.384382 Feb 17 04:36:14.335864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 159/318] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:13 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:14.938152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:14.939497 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:14.953861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:14.955857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:14.962130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:14.963119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.303204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:15.315370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-61eaf860-e1d7-4871-ae6f-2384ca7ab408 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.381718 Feb 17 04:36:15.316573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 160/319] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:14 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:15.349855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:15.353034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:15.366855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:15.367842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.369069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:15.369961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.806604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:15.829600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:15.843467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:15.845004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9b53a6a7-c3cb-407a-a9ac-e48aa539d79f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.502671 Feb 17 04:36:15.845783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 161/320] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:15 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:36:16.339131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:16.340445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:16.350346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.351141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.356207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.357732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.742944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:16.754985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-aec02462-30e6-4c65-becd-5e6e4f5f48bb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.424520 Feb 17 04:36:16.755945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 162/321] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:16 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:16.879906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:16.881574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:16.894973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.896016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.896891 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.897388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.259651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:17.271275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:17.276953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:17.278568 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-db0d6e6a-bcb1-4f22-a70c-73d8e359d098 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.403162 Feb 17 04:36:17.280340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 163/322] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:16 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:17.774075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:17.775031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:17.818329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.824388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.828133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.837297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.175749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:18.187253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-90cd9869-8568-49e6-98bd-39806dc0c1ee tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.417804 Feb 17 04:36:18.188197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 164/323] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:17 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:18.193825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:18.195244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:18.204689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.205480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.206648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.207392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.283603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lazy-loading 'flavor' on Instance uuid 2641c971-9a8a-467c-92f1-1317f397e36f {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:36:18.860216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1450afa6-2c9b-4ed6-ba84-d8dbac18933a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action" status: 200 len: 32 microversion: 2.1 time: 0.670299 Feb 17 04:36:18.867824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 165/324] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:18 2021] POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action => generated 32 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:36:18.881983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:18.883010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:18.904951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.907942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.907942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.907942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.710189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:19.746713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:19.750526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:19.760935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-97652b89-a903-4d0a-b456-c16d0c9532e0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.892570 Feb 17 04:36:19.761593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 166/325] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:18 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:19.784674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:19.788635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:19.804714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.805270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.806177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.806682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:21.138741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:21.169854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a0cf7f88-7301-491b-8f6f-a226fed34a65 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 1.392177 Feb 17 04:36:21.182040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 167/326] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:19 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:21.187720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:21.188651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:21.200802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:21.201952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:21.202934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:21.203533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:21.878026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:21.917175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-69c61a48-b3fd-40a6-95b1-90182bc985e1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.742454 Feb 17 04:36:21.918580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 168/327] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:21 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:21.929529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:21.931368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:21.947652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:21.948584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:21.950977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:21.952935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:22.460072 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:22.482667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:22.482667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:22.482667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6af6930e-b110-40e3-a54e-cf06426af982 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.557580 Feb 17 04:36:22.483915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 169/328] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:21 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:22.485090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:22.485842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:22.494264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:22.495140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:22.496081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:22.496638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:23.296397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:23.308759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b91f0584-ba94-4724-b4a7-a3f134b4b5fc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 0.828667 Feb 17 04:36:23.327214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 170/329] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:22 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:23.327214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:23.327214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:23.335831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:23.336436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:23.337413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:23.338138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:23.819305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:23.819305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4e2bf3d4-85f7-4d20-9965-0a08f36dd968 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.465417 Feb 17 04:36:23.819305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 171/330] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:23 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:23.819305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:23.820537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:23.820537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:23.820537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:23.820537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:23.820803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.098220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:24.114860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:24.116727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:24.118091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-40fb24f0-49ec-4988-a7fc-56258e502a42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.321859 Feb 17 04:36:24.118955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 172/331] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:23 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:24.329159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:24.329849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:24.338104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.338658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.339547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.340055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.643522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:24.679449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-22bdc54a-a2e6-4128-ba41-66418a582f38 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 0.351298 Feb 17 04:36:24.686700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 173/332] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:24 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:24.811051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:24.811754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:24.824605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.825123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.846848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.846848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:25.105283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] validate_networks() for [('b3751aa1-d0d2-4655-997c-f8c5fd944ed5', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:25.243409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:25.258060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8458a801-f468-4699-a555-da868a98d8eb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.450987 Feb 17 04:36:25.271134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 174/333] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:24 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:25.271134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8260255c-d64f-4a42-be5e-9705dec52226 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: .version_select at 0x7f9b3c9b1378>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2103323820"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:25.300798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-8260255c-d64f-4a42-be5e-9705dec52226 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Getting quotas for project 14187639adc74d1bb49ed835b238d04c. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:25.316754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-8260255c-d64f-4a42-be5e-9705dec52226 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Getting quotas for user cd27797b6e42486d9bdeef931160b837 and project 14187639adc74d1bb49ed835b238d04c. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:25.684965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-8260255c-d64f-4a42-be5e-9705dec52226 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Getting quotas for project 14187639adc74d1bb49ed835b238d04c. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:25.706449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-8260255c-d64f-4a42-be5e-9705dec52226 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Getting quotas for user cd27797b6e42486d9bdeef931160b837 and project 14187639adc74d1bb49ed835b238d04c. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:25.753078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8260255c-d64f-4a42-be5e-9705dec52226 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.490419 Feb 17 04:36:25.753745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 175/334] 10.222.0.73 () {60 vars in 1148 bytes} [Wed Feb 17 04:36:25 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:25.793730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:25.794475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:25.808932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:25.810424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:25.812914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:25.814168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.202188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:26.220660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:26.224210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:26.225533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:26.226269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:26.227304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:26.227946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a7e4e2ca-111f-49d0-9989-00dec477821f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.439433 Feb 17 04:36:26.228070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:26.228772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:26.229375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 176/335] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:25 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:26.241588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:26.243602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:26.249994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.250700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.257062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.258413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.272861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.275982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.277206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.277746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.291550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Getting quotas for project dd5defbe82e641678f7511f3f14fefbf. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:26.306122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Getting quotas for user 980b70ffb35940bea61a77850e703190 and project dd5defbe82e641678f7511f3f14fefbf. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:26.323591 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:26.328615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:26.614256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d62d26e3-b3ba-492d-b6bd-f4fef2e4e2d5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.171352 Feb 17 04:36:26.616024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 160/336] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:36:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 14181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:36:26.637876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2054290371", "imageRef": "f53f9804-de4a-40d9-b6c7-a4443ac7d2ab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2103323820", "networks": [{"uuid": "25653d82-43fa-4aa5-a3be-d27965409dd3"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:26.806481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:26.841770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-59569af5-6feb-4e8f-849e-15d387b09c19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 0.608106 Feb 17 04:36:26.844472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 177/337] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:26 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:26.864050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] validate_networks() for [('25653d82-43fa-4aa5-a3be-d27965409dd3', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:26.875166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:26.876084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:26.884845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.885524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.886674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.887906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:27.213445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:27.246564 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-697f8fea-f4ce-4b8e-894b-00a4ff36a373 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.376078 Feb 17 04:36:27.258664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 178/338] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:26 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:27.286638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-86f1e4f4-08a3-4545-8d6b-eada5dfa1434 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:27.287918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-86f1e4f4-08a3-4545-8d6b-eada5dfa1434 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:27.601674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-86f1e4f4-08a3-4545-8d6b-eada5dfa1434 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:27.633711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-86f1e4f4-08a3-4545-8d6b-eada5dfa1434 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1214 microversion: 2.1 time: 0.371268 Feb 17 04:36:27.640250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 179/339] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:27 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1214 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:27.695070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:27.698621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:27.734547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:27.735060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:27.755035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:27.755598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.388635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:28.400139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:28.401772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:28.403003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7ff16f40-bb14-4870-a7b0-abf176d4dc4c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.745649 Feb 17 04:36:28.403660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 180/340] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:27 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:28.421804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:28.423120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:28.454497 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.455523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.462820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.464077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.580853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:28.581335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:28.581890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:28.582362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:28.582836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:28.602679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.603198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.604144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.604650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.661914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Getting quotas for project 14187639adc74d1bb49ed835b238d04c. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:28.674534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Getting quotas for user cd27797b6e42486d9bdeef931160b837 and project 14187639adc74d1bb49ed835b238d04c. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:28.723372 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:28.725814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f53f9804-de4a-40d9-b6c7-a4443ac7d2ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:28.850061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3754509f-c663-4603-8dd2-28f4314590aa tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232548 Feb 17 04:36:28.851166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 161/341] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:36:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:36:28.866382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:28.875560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:28.892113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.892895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.894004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.895986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.204708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.223590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1a5ff529-964e-4deb-998e-55108ad1c461 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 0.817868 Feb 17 04:36:29.224668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 181/342] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:28 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:29.236205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:29.239907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:29.271477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.280693 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.283386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.284764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.285034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c4cb9f50-5730-48c6-a8bd-7bc27d162d74 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.426694 Feb 17 04:36:29.285588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.285955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 162/343] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:28 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:29.290829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-abd4cc25-3105-40d4-bd97-9caf6cd267e0 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:29.291544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-abd4cc25-3105-40d4-bd97-9caf6cd267e0 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:29.423196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-abd4cc25-3105-40d4-bd97-9caf6cd267e0 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.435866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-abd4cc25-3105-40d4-bd97-9caf6cd267e0 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1259 microversion: 2.1 time: 0.148465 Feb 17 04:36:29.446962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 163/344] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:29 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:29.453321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:29.454199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:29.462817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.463319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.464189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.464955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.478245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.508063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2f95d152-3082-4c6c-999f-6ceddd08a159 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1210 microversion: 2.1 time: 0.281408 Feb 17 04:36:29.518865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 182/345] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:29 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1210 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:29.806366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.845638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.857100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.860409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f24cac6d-ed5d-4629-8c0e-7cbb69d745c2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 0.411540 Feb 17 04:36:29.861251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 164/346] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:29 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:30.267242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:30.272391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:30.305129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.317343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:30.318276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:30.323107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.324336 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.324946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.340900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.341919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.345934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.350213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.774442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:30.789947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0ddd7d0f-1cb5-46ef-aaf8-1df1bf0ca372 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.479144 Feb 17 04:36:30.791141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 165/347] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:30 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:30.800130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:30.801474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:30.813554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.814399 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.815643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.816704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.013883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:31.022913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:31.024337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8ed5fe07-26de-4ee2-87fd-7f6e50a8cdd6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1263 microversion: 2.1 time: 0.231608 Feb 17 04:36:31.025266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 166/348] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:30 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1263 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:31.043162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:31.044165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:31.049175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-14ca35f5-54c5-4e72-a62d-cbdf113e529a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 0.806166 Feb 17 04:36:31.049824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 183/349] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:30 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:31.053201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.053967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.055303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.056001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.068260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:31.069017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:31.085858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.086353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.087254 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.087817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.443216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:31.499084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1ad68fdb-5dbf-49e2-a5e4-5774998b4327 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1274 microversion: 2.1 time: 0.461432 Feb 17 04:36:31.499749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 167/350] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:31 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1274 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:31.816646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:31.823327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:31.873822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.880130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.883408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.886094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.374360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.391220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7cfebd41-5e2a-47f4-a319-f60f4e0f5b83 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.583645 Feb 17 04:36:32.395106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 168/351] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:31 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:32.402841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:32.410463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:32.446453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.446898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.447993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.448504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.461476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.472559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.486116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.487673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-efc5a546-1ee7-4989-88fc-30696c3ca54b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 1.423506 Feb 17 04:36:32.488427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 184/352] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:31 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:32.515373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:32.517130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:32.534489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.535843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.537777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.538957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.735635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.761352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7ed57dfc-14e2-47e5-91d6-58156fcdb83f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1311 microversion: 2.1 time: 0.364518 Feb 17 04:36:32.762886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 169/353] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:32 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1311 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:32.772627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:32.774311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:32.787541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.788062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.788921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.789422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.030890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:33.099085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0e941480-8186-4750-b8a6-fa763fefaaf2 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1272 microversion: 2.1 time: 0.333872 Feb 17 04:36:33.100708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 170/354] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:32 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:33.227632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:33.241489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-34337f1c-c0dd-4b52-b8d0-01c05af7cccc tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1569 microversion: 2.1 time: 0.739431 Feb 17 04:36:33.242841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 185/355] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:32 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1569 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:33.424799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:33.425504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:33.438275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.438790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.439670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.440163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.524459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:33.524459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:33.546438 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.557554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.571243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.571916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.748291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:33.770632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6775b9ac-7c03-4779-82a5-be2b35c7bdf9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.361393 Feb 17 04:36:33.803821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 171/356] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:33 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:33.811682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:33.812514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:33.858983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.865198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.866932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.868212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:34.735040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:34.750185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b4396098-2b4d-49db-9fcc-901a4f99fff1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1317 microversion: 2.1 time: 0.944702 Feb 17 04:36:34.751509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 172/357] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:33 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:34.757026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:34.757961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:34.771962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:34.774141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:34.776164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:34.776956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:34.957893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:34.970013 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:34.971857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:34.973451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8c587c96-a77e-4f9d-bc8a-198241f2b8fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1739 microversion: 2.20 time: 1.465509 Feb 17 04:36:34.974149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 186/358] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:33 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1739 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:36:34.990161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:34.991933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:35.003887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:35.005002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:35.006771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:35.007766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:35.737436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:35.763859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7f063b5c-c57d-4110-b2b9-22f9be0dc52d tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 1.002164 Feb 17 04:36:35.764883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 173/359] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:34 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:35.774464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:35.780224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:35.797852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:35.799188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:35.809022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:35.809977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:36.490799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:36.521790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2289837f-859c-4404-81a9-f0af11a5ed6e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 0.755387 Feb 17 04:36:36.522824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 174/360] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:35 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:36.538768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:36.540577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:36.553225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:36.554189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:36.555646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:36.556365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:36.881184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:36.918308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5d0796df-a764-457e-bed8-26baf4c34c0e tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1549 microversion: 2.1 time: 1.939430 Feb 17 04:36:36.920122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 187/361] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:34 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1549 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:36.936827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:36.942124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:36.972875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:36.975924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:36.980035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:36.981215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:37.980431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:37.997290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e4212b0d-9596-4bed-8085-0fbc9776d8f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 1.472957 Feb 17 04:36:38.001193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 175/362] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:36 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:38.013814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:38.017216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:38.045061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:38.049309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:38.051548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:38.058037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:38.764050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:38.780309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f1db1305-c379-4b43-bd70-0ba1e51efea4 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.777596 Feb 17 04:36:38.780929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 176/363] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:38 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:38.790282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:38.790847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:38.808526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:38.809049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:38.812918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:38.813543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:39.139596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:39.159587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:39.161500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:39.163426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-88b931a3-36b0-427d-9de0-6404f0f743b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 2.238732 Feb 17 04:36:39.164703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 188/364] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:36 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:39.170176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:39.171080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:39.180757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:39.181676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:39.183335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:39.184449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:39.451088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] HTTP exception thrown: Cannot 'detach_volume' instance 2641c971-9a8a-467c-92f1-1317f397e36f while it is in vm_state rescued Feb 17 04:36:39.471881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Returning 409 to user: Cannot 'detach_volume' instance 2641c971-9a8a-467c-92f1-1317f397e36f while it is in vm_state rescued {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:39.473463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c626fd08-4b19-4adc-a525-52b99ab7af00 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments/1d5706be-4fbf-4c60-956b-d0df88b0de96" status: 409 len: 152 microversion: 2.1 time: 0.691353 Feb 17 04:36:39.479124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 177/365] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:36:38 2021] DELETE /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments/1d5706be-4fbf-4c60-956b-d0df88b0de96 => generated 152 bytes in 694 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 04:36:39.552175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:39.560878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:39.602821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:39.610675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:39.611687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:39.613976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.089595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:40.105897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-206b2481-ed56-4532-ac44-3e07d42ac250 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.628963 Feb 17 04:36:40.109344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 178/366] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:39 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:40.128144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:40.128608 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:40.152920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.155245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.156384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.157035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.431115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:40.446042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-989dada3-8e3f-4395-8f11-06569c00eacf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1723 microversion: 2.1 time: 1.279444 Feb 17 04:36:40.473902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 189/367] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:39 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1723 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:40.473902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:40.473902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:40.473902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.473902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.475009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.475009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.571746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-29ba9e3c-277e-410d-885f-ffcfaaedfa72 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action" status: 202 len: 0 microversion: 2.1 time: 0.447388 Feb 17 04:36:40.573014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 179/368] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:40 2021] POST /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:40.579315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:40.594415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:40.615471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.616700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.618597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.619646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:41.067561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:41.094076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:41.096989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:41.099031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-455c62df-f719-4eac-8c44-7edc9939165a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.524695 Feb 17 04:36:41.100296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 180/369] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:40 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:41.107388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:41.109732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:41.165711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:41.168101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:41.172709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:41.177218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:41.957003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:41.969970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-017af0a4-acda-4e3c-9f95-5bed2fe8f578 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 1.521296 Feb 17 04:36:41.977196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 190/370] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:40 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:41.986777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:41.987713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:42.005889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:42.006411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:42.008260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:42.010764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:42.336791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:42.369045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3e2b4c10-4841-4929-ab1b-0e75dcbe76c4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 1.266992 Feb 17 04:36:42.383317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 181/371] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:41 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:42.388461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:42.389494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:42.417480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:42.417993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:42.419011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:42.419551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.111964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:43.142172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ad9a690b-3d12-4ff3-9d42-08a775442509 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1700 microversion: 2.1 time: 0.769231 Feb 17 04:36:43.143358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 182/372] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:42 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1700 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:43.168258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-59dd6a27-5f19-4271-b8d6-0232fc940541 req-f0115af5-ece2-42a8-8963-71bf5465f8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204358c6-0e55-43d0-9716-3a5e4232673c", "tag": "fc869d8b-0fc9-4051-9ff9-d664363c0879"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:43.172785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:43.172785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:43.222866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-59dd6a27-5f19-4271-b8d6-0232fc940541 req-f0115af5-ece2-42a8-8963-71bf5465f8db service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.223823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-59dd6a27-5f19-4271-b8d6-0232fc940541 req-f0115af5-ece2-42a8-8963-71bf5465f8db service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.289031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-59dd6a27-5f19-4271-b8d6-0232fc940541 req-f0115af5-ece2-42a8-8963-71bf5465f8db service nova] Creating event network-changed:fc869d8b-0fc9-4051-9ff9-d664363c0879 for instance 204358c6-0e55-43d0-9716-3a5e4232673c on hv-cinder-75995 Feb 17 04:36:43.299220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-59dd6a27-5f19-4271-b8d6-0232fc940541 req-f0115af5-ece2-42a8-8963-71bf5465f8db service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153941 Feb 17 04:36:43.299934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 183/373] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:43.305575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:43.306279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:43.316902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.317551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.319164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.319164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.989817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.000864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.002828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.004308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-172e2d72-6bce-41b4-8717-a4f02615c5f0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.703191 Feb 17 04:36:44.005067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 184/374] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:43 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:44.011267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:44.018573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:44.022435 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.023268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.024443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.025188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.139197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.179995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-28d5c8e7-031e-4c75-bdea-6091dcc2cb9c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 2.199991 Feb 17 04:36:44.187384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 191/375] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:41 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:44.213479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ac98437e-e982-4243-8182-1727d1d98f7a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:44.231723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac98437e-e982-4243-8182-1727d1d98f7a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.234092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac98437e-e982-4243-8182-1727d1d98f7a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.436665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ac98437e-e982-4243-8182-1727d1d98f7a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Going to try to start instance {{(pid=98221) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 04:36:44.606038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.624990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-353c2b82-2904-49c8-88d9-14a455470012 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.618427 Feb 17 04:36:44.626010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 185/376] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:44 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:44.633925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:44.635495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:44.645641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.646519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.647632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.648671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.678248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ac98437e-e982-4243-8182-1727d1d98f7a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 202 len: 0 microversion: 2.1 time: 0.472927 Feb 17 04:36:44.679507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 192/377] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:44 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:44.701227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:44.702466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:44.715439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.717033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.720390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.723130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.928204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.938864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-778f4dd0-3317-45c4-ab73-1b377ec02d0c tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.311620 Feb 17 04:36:44.939521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 186/378] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:44 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:45.013355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.023314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-67c42f7a-1fd2-4ca4-91b2-92aaa691bd3b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 0.336398 Feb 17 04:36:45.023997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 193/379] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:44 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:45.046148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.047005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.055103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.055661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.056507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.057006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.211699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.212420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.222121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.223256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.223683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.224189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.288979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.305832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.308861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.311063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-274abed4-845a-4bfe-81b9-b6f48a2aaa39 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.272385 Feb 17 04:36:45.312617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 187/380] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:45.363668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-4b575296-63ff-42e8-a191-90701fc7551e req-3e5d0397-b853-42ea-acce-3011ba190b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:45.365696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:45.365696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:45.377331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-4b575296-63ff-42e8-a191-90701fc7551e req-3e5d0397-b853-42ea-acce-3011ba190b75 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.377812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-4b575296-63ff-42e8-a191-90701fc7551e req-3e5d0397-b853-42ea-acce-3011ba190b75 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.396553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-4b575296-63ff-42e8-a191-90701fc7551e req-3e5d0397-b853-42ea-acce-3011ba190b75 service nova] Creating event network-changed:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:36:45.402933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-4b575296-63ff-42e8-a191-90701fc7551e req-3e5d0397-b853-42ea-acce-3011ba190b75 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043042 Feb 17 04:36:45.404230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 188/381] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:36:45.471168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.487881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a73f60ab-e8e2-4104-a73e-562cfff841f1 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.280436 Feb 17 04:36:45.488531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 194/382] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:45.656425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.657220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.666110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.666806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.667980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.668478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.910123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.919851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-300a9be6-57b4-4e35-8171-1794ffacee30 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.269269 Feb 17 04:36:45.920465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 189/383] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:45.958033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.958703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.966839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.967410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.968276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.968777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.042580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:46.043135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:46.052745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.054425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.054425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.054425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.201761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.211904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-14b47659-772f-422f-9fff-0709ee82cf19 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.257741 Feb 17 04:36:46.212579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 195/384] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:46.289095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.298915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1f46bccd-c21d-42fb-8374-8b6cba97cbd9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 0.260599 Feb 17 04:36:46.299478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 190/385] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:46 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:46.334018 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:46.334680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:46.342893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.343425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.344276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.344761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.506719 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:46.507453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:46.516726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.517521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.518398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.518923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.593299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.608931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.611270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.612970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d8e7df1e-0c6d-4527-b70f-42a027308383 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.283004 Feb 17 04:36:46.614099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 196/386] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:46 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:46.939274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:46.939854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:46.942321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.948382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.949729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.950165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.950663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.956453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d64b28fd-ee02-4a48-9f0c-af78224a317f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.453941 Feb 17 04:36:46.958771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 191/387] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:46 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:47.306171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:47.306995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:47.319212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:47.319212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:47.320877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:47.322512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:47.382347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:47.398421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-04810353-c5a5-4fe2-a084-e7f3bb0c806f tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.463620 Feb 17 04:36:47.405780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 197/388] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:46 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:47.419922 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:47.420852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:47.433040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:47.440159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:47.442484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:47.442484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:47.650812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:47.673927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-494a73ac-1c76-4a28-94b4-3476f114626f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.445492 Feb 17 04:36:47.676076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 192/389] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:47 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:47.697864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:47.698695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:47.709712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:47.710227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:47.711124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:47.711777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:47.875508 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:47.895578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-29c78fd0-f66b-4136-bcc9-e91d3c10b446 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 0.486851 Feb 17 04:36:47.899458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 198/390] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:47 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:47.985097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:47.986079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:48.004103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.005460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.008160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.013781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.175949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.186657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.193098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.193098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cb222d8c-9987-4410-ac0c-11b33473d47b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.504863 Feb 17 04:36:48.193098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 193/391] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:47 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:48.306951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.318186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f0727364-cbe2-4f7c-ae45-f120dab134f7 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.339388 Feb 17 04:36:48.319024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 199/392] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:47 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:48.432276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:48.432969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:48.441913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.442425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.443335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.443803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.694673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:48.695383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:48.705043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.705575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.706448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.706948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.770148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.798990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d023f081-ae16-4199-943d-cd51fc09077e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.370931 Feb 17 04:36:48.810094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 194/393] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:48 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:48.921821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:48.922485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:48.932985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.933501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.935122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.935668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.030346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.052139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ccb86df7-faed-41bd-88bc-0e569647a2d2 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.363515 Feb 17 04:36:49.054479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 200/394] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:48 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:49.202937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.212878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ba1af189-c7ec-49d0-8975-43978a1d5e99 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 0.294865 Feb 17 04:36:49.213491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 195/395] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:48 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:49.213812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.214484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:49.222474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.223005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.223934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.224423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.339405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.340066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:49.348748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.349346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.350208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.350704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.480382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.491926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.493512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.494770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1b2574ba-0f61-4cdb-8b6d-4dbbd98e8ae7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.285048 Feb 17 04:36:49.495468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 201/396] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:49 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:36:49.605437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.622685 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d65f95e0-1465-48ab-bdf2-e08565c7d4b2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.288918 Feb 17 04:36:49.623323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 196/397] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:49 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:49.818441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.819192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:49.827727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.828241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.829105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.829614 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.060979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.073717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-bf9e06fb-ec4c-4538-aa85-b828039f88d9 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.259364 Feb 17 04:36:50.074342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 202/398] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:49 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:50.079609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.080327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.088516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.089029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.089884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.090403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.233359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.234404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.245802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.247304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.248670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.249803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.332331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.349507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ceb17e89-c1dc-432b-b6e3-10defa523171 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.274761 Feb 17 04:36:50.350780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 197/399] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:50.502627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.517267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-63c245e7-95b0-4000-b3f9-d90e1b1ce361 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 0.289310 Feb 17 04:36:50.518290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 203/400] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:50.518834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.520070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.536332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.537297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.538345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.538928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.642190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.643822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.653378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.653996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.654974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.655610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.789873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.800807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.802402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.803698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c47977de-1838-4e5e-b32d-7632b2dea596 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.292389 Feb 17 04:36:50.804513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 198/401] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:50.912252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.922257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4e5bc797-c7d9-435a-a0dc-1a99088d6dc2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.284508 Feb 17 04:36:50.922883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 204/402] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:51.094646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.095240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.103249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.103793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.104682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.105178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.348581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.358829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a833b776-54fb-4967-a610-5fccf3377c03 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.268778 Feb 17 04:36:51.359548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 199/403] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:51.383862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.398539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.398539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.398539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.398539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.399856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.546805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.548369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.560601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.564774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.564774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.564774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.794349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.808126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1812c9bd-d1d3-43b8-8ec1-356601bdb3eb tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.433142 Feb 17 04:36:51.809576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 205/404] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:51.830278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.831639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.832444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.842250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.842490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.844065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.844065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.852566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-36f210a6-029f-4e95-81fe-cd197ee60ade tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 0.310282 Feb 17 04:36:51.855439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 200/405] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:51.940699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.942217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.954887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.956020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.957482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.958339 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.099045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.110614 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.112349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.113586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b8418815-d27c-4da3-bd6d-4d0fc23154e8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.294069 Feb 17 04:36:52.114182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 206/406] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:52.334810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.344689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-19e43806-cb79-4e8f-a124-409d10933ba2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.408063 Feb 17 04:36:52.345691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 201/407] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:52.379617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:52.380199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:52.390544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.391613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.392621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.393177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.832264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:52.833197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:52.845115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.845928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.847009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.847829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.221756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:53.239159 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0b42275d-a278-4d8f-bc93-fffac92b6db5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.862469 Feb 17 04:36:53.261063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 207/408] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:52 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:53.268850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:53.270345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:53.285613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.287245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.291716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.291716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.487156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:53.505886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8a0a00b0-c65e-40a2-8ed0-d379798e44d8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1557 microversion: 2.1 time: 0.679972 Feb 17 04:36:53.506777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 202/409] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:52 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1557 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:53.514144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:53.514144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:53.523258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.524148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.525331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.526044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.169895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.190423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.197286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.201509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f8d5680d-3813-40ff-9917-e6782aa5dec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1721 microversion: 2.20 time: 0.690793 Feb 17 04:36:54.202555 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 203/410] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:53 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1721 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:54.225475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.226490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:54.237300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.238121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.239201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.239991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.538429 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.555293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a719ef26-30e2-40cf-b703-fa957d9161b6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1709 microversion: 2.1 time: 1.291449 Feb 17 04:36:54.555859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 208/411] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:53 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1709 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:54.571210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d69c8622-45bf-422a-8942-071521ffec50 req-a03834d3-2706-4b92-bfdf-20daa432b7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "name": "network-vif-unplugged", "status": "completed", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:54.573129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:54.573129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:54.593477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d69c8622-45bf-422a-8942-071521ffec50 req-a03834d3-2706-4b92-bfdf-20daa432b7d9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.593979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d69c8622-45bf-422a-8942-071521ffec50 req-a03834d3-2706-4b92-bfdf-20daa432b7d9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.635982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d69c8622-45bf-422a-8942-071521ffec50 req-a03834d3-2706-4b92-bfdf-20daa432b7d9 service nova] Creating event network-vif-unplugged:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:36:54.661276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d69c8622-45bf-422a-8942-071521ffec50 req-a03834d3-2706-4b92-bfdf-20daa432b7d9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093980 Feb 17 04:36:54.669565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 209/412] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:54.675478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.676367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:54.700390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.701633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.702755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.705671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.871177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.881081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3a6f674e-bcf9-42a1-b615-dd32f445c4b4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.665009 Feb 17 04:36:54.891703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 204/413] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:54.891703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.891703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:54.904793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.905549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.906510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.907113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.202627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.216450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-295dca76-d9f5-433c-bd3a-775d4240dc0d tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1563 microversion: 2.1 time: 0.331449 Feb 17 04:36:55.216450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 205/414] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1563 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:55.234770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:55.235791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.246071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.247889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.249259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.250080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.264753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.279770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-98ee9558-b093-4377-87ac-0129f83744fe tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.606078 Feb 17 04:36:55.282468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 210/415] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:55.384864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:55.385529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.395310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.395906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.399394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.399394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.552951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.565282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.566838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.568350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-71e8b155-b162-40c5-88e0-c21bbc09682e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1664 microversion: 2.20 time: 0.342834 Feb 17 04:36:55.569364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 206/416] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:55 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1664 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:55.575233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:55.575937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.584691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.585212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.586083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.586584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.614703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lazy-loading 'services' on Instance uuid 2641c971-9a8a-467c-92f1-1317f397e36f {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:36:55.896951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.911340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-33b66094-809e-4491-b5b0-bbc6b8adb7ec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1713 microversion: 2.1 time: 0.339926 Feb 17 04:36:55.912631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 207/417] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:55 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1713 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:55.933728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066805b7-5b7f-4972-8ce7-93b216dfa7d3"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:55.933728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.940089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.940851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.941378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.941975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.998701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cd638e42-1f84-4954-a42d-8d60ef30b270 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments/1d5706be-4fbf-4c60-956b-d0df88b0de96" status: 202 len: 0 microversion: 2.1 time: 0.619009 Feb 17 04:36:56.000694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 211/418] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:36:55 2021] DELETE /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f/os-volume_attachments/1d5706be-4fbf-4c60-956b-d0df88b0de96 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:56.008926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:56.009976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:56.020934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.025955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.027797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.028473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.271765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:56.282484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2799958f-03d2-4d19-98da-cf1eaf15b86b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.281511 Feb 17 04:36:56.283431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 212/419] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:55 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:56.304189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:56.304189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:56.316491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.317437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.318913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.319934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.556203 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:56.566120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-32bdc5d1-2e4a-409b-b79a-47c4f634d71c tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.269177 Feb 17 04:36:56.566915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 213/420] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:56 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:56.680595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-de1178c9-be16-4a3b-ae18-57c77cd9a370 req-8a67a161-fabf-41eb-aa80-fd2e25be8cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204358c6-0e55-43d0-9716-3a5e4232673c", "name": "network-vif-plugged", "status": "completed", "tag": "fc869d8b-0fc9-4051-9ff9-d664363c0879"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:56.683352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:56.683352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:56.696045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-de1178c9-be16-4a3b-ae18-57c77cd9a370 req-8a67a161-fabf-41eb-aa80-fd2e25be8cb5 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.697226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-de1178c9-be16-4a3b-ae18-57c77cd9a370 req-8a67a161-fabf-41eb-aa80-fd2e25be8cb5 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.717636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-de1178c9-be16-4a3b-ae18-57c77cd9a370 req-8a67a161-fabf-41eb-aa80-fd2e25be8cb5 service nova] Creating event network-vif-plugged:fc869d8b-0fc9-4051-9ff9-d664363c0879 for instance 204358c6-0e55-43d0-9716-3a5e4232673c on hv-cinder-75995 Feb 17 04:36:56.723190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-de1178c9-be16-4a3b-ae18-57c77cd9a370 req-8a67a161-fabf-41eb-aa80-fd2e25be8cb5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048139 Feb 17 04:36:56.723954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 214/421] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:36:57.030303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c6ba43fd-b5c1-4c0a-a40e-ccc620848faf tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.116187 Feb 17 04:36:57.031138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 208/422] 10.222.0.73 () {62 vars in 1354 bytes} [Wed Feb 17 04:36:55 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-volume_attachments => generated 188 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:36:57.316466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:57.317200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:57.317466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:57.318030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:57.327241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.327790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.328664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.329099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.329239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.329905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.331065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.331750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.602054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.608045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d347b603-ef77-413f-8074-1e684dbe025a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action" status: 202 len: 0 microversion: 2.20 time: 0.295248 Feb 17 04:36:57.613053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 209/423] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:57 2021] POST /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:36:57.617119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-69846282-4ea3-43e1-b008-e4f6a11158cb tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.317681 Feb 17 04:36:57.622783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:57.623765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:57.628502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 215/424] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:57 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:57.633623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:57.634298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:57.634782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.635628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.636765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.638115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.643527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.644460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.645100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.645595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.932669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.946124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.948480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.950959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8fe6b0ea-61ab-44ef-90a4-7a01977be9f5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1750 microversion: 2.20 time: 0.320995 Feb 17 04:36:57.952311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 216/425] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:57 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1750 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:58.009042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.027580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-362d2fe0-30d1-4c35-bdf0-25ef442c2c86 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1314 microversion: 2.1 time: 0.410900 Feb 17 04:36:58.028362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 210/426] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:57 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:58.636498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:58.637169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:58.645300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.645817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.646849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.647180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.737972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-1a2edd46-7173-496b-aabe-2f6423f48314 req-10255354-9da2-4e07-8313-4a2b41f9c519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "name": "network-vif-plugged", "status": "completed", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:58.739896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:58.739896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:36:58.749727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-1a2edd46-7173-496b-aabe-2f6423f48314 req-10255354-9da2-4e07-8313-4a2b41f9c519 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.750356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-1a2edd46-7173-496b-aabe-2f6423f48314 req-10255354-9da2-4e07-8313-4a2b41f9c519 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.769376 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-1a2edd46-7173-496b-aabe-2f6423f48314 req-10255354-9da2-4e07-8313-4a2b41f9c519 service nova] Creating event network-vif-plugged:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:36:58.774860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-1a2edd46-7173-496b-aabe-2f6423f48314 req-10255354-9da2-4e07-8313-4a2b41f9c519 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040958 Feb 17 04:36:58.775589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 211/427] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:58.868042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.877026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2c8081e9-08ed-4947-abaa-cba59274fbbc tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.244784 Feb 17 04:36:58.877638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 217/428] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:58 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:58.973060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:58.973831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:58.982810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.983359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.984294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.984842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.046663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:59.047810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:59.055539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.056093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.056964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.057465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.209726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.221153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.222979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.224678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d3a7dd16-94bb-4f5e-b9c6-4dbd993c6031 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1750 microversion: 2.20 time: 0.256600 Feb 17 04:36:59.225660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 212/429] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:58 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1750 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:59.284424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.294142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b3be568d-bb39-49ec-943c-9f184a06b081 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1498 microversion: 2.1 time: 0.251636 Feb 17 04:36:59.294816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 218/430] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:59 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:59.896182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:59.896854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:59.905311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.905814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.906662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.907152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.121535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.130456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a04d1086-b1b5-493c-af59-3a8852f03d7a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.238616 Feb 17 04:37:00.131260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 213/431] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:59 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:00.249827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:00.250559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:00.258777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.259335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.260170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.260696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.482804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.496570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.498186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.499434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b1c2c7b9-4b3d-4d6b-926d-cb491296b6e5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1750 microversion: 2.20 time: 0.253723 Feb 17 04:37:00.500118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 219/432] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:00 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1750 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:01.148646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:01.149569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:01.161953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.162476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.163633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.164142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.411934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.423603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-81112e87-dc2b-4fdd-81a8-fc0d27ace8f9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.279007 Feb 17 04:37:01.424238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 214/433] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:01 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:01.519005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:01.520029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:01.530192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.530920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.532272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.532910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.794105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.804987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.806659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.808031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-33223eba-6f1f-4a78-882f-2811462f5254 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1752 microversion: 2.20 time: 0.293181 Feb 17 04:37:01.815720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 220/434] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:01 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1752 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:02.055309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:02.055845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:02.065630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.066136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.067000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.067531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.137418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:37:02.437122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2f70e8e8-4654-4540-a208-1ab51c8faff5 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "DELETE /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 204 len: 0 microversion: 2.1 time: 0.385617 Feb 17 04:37:02.441260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 215/435] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:02 2021] DELETE /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:37:02.444061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:02.444730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:02.450787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:02.451706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:02.461242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.461242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.461242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.461242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.461715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.462131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.463151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.463844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.727270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.739683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ff7ec7e8-536c-4e7f-8bbb-37095ed1e25e tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1504 microversion: 2.1 time: 0.294290 Feb 17 04:37:02.740601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 216/436] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:02 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:02.778747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.788204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fdf12ad6-4d3e-4346-87f5-623518484a8a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1359 microversion: 2.1 time: 0.348077 Feb 17 04:37:02.788764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 221/437] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:02 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:02.836585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:02.837291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:02.846068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.846581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.847539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.848045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.202437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.214695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.217310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.218832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-92d986ea-f8af-435f-855a-f07bcbc599c9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1752 microversion: 2.20 time: 0.386433 Feb 17 04:37:03.219540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 217/438] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:02 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1752 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:03.766248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:03.767709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:03.776378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.779908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.779908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.779908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.806378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:03.807137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:03.816745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.817661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.818644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.819253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.055571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.067580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4ff3ddd3-0442-4357-95f3-236b93005550 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1549 microversion: 2.1 time: 0.265036 Feb 17 04:37:04.068126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 218/439] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:03 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1549 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:04.087486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.088281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.097070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.097679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.098838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.099526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.374331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.385773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a31f205a-22e2-454a-8454-a9750b86324a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1549 microversion: 2.1 time: 0.302407 Feb 17 04:37:04.386142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 219/440] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1549 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:04.391635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.392330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.400476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.408884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.408884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.408884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.643440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.656261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.657967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.659487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e12da453-85fb-4906-9adb-c987475af261 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1752 microversion: 2.20 time: 0.271974 Feb 17 04:37:04.668538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 220/441] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:04.668538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.670267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:04.670267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:04.671347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.672310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Searching by: {'deleted': False, 'project_id': '14187639adc74d1bb49ed835b238d04c'} {{(pid=98222) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 17 04:37:04.678599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.683106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.683106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.683106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.789166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.multi_cell_list [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98222) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 17 04:37:04.871107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.885402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1411d0fd-ee5d-43e2-9935-853d28bae62b tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1504 microversion: 2.1 time: 1.123699 Feb 17 04:37:04.899144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 222/442] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:03 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1504 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:04.906304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.907118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.915484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4210186f-fbea-4796-ab18-f75256413cb4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.253689 Feb 17 04:37:04.915683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.916397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.917191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 221/443] 10.222.0.73 () {58 vars in 1115 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers => generated 343 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:04.918048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.918748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.928818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.929497 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.938629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.939540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.940017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.940521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.998478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:37:05.189440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.201042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-62ffcfeb-4639-4a31-b114-a664a40ba375 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1549 microversion: 2.1 time: 0.276663 Feb 17 04:37:05.221128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 222/444] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1549 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:05.298679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-39eb7e78-4330-42a4-944c-a2d869510270 req-8704a4bc-db6b-44c6-980e-35cae0a7fd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204358c6-0e55-43d0-9716-3a5e4232673c", "name": "network-vif-unplugged", "status": "completed", "tag": "fc869d8b-0fc9-4051-9ff9-d664363c0879"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:05.301726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:05.301726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:05.311958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-39eb7e78-4330-42a4-944c-a2d869510270 req-8704a4bc-db6b-44c6-980e-35cae0a7fd16 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.312668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-39eb7e78-4330-42a4-944c-a2d869510270 req-8704a4bc-db6b-44c6-980e-35cae0a7fd16 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.332757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-39eb7e78-4330-42a4-944c-a2d869510270 req-8704a4bc-db6b-44c6-980e-35cae0a7fd16 service nova] Creating event network-vif-unplugged:fc869d8b-0fc9-4051-9ff9-d664363c0879 for instance 204358c6-0e55-43d0-9716-3a5e4232673c on hv-cinder-75995 Feb 17 04:37:05.339036 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-39eb7e78-4330-42a4-944c-a2d869510270 req-8704a4bc-db6b-44c6-980e-35cae0a7fd16 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046016 Feb 17 04:37:05.342565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 223/445] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:05.568054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-67021f58-3a6b-44a3-b101-5c1e90f11cb0 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "DELETE /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 204 len: 0 microversion: 2.1 time: 0.666480 Feb 17 04:37:05.568391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 223/446] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:04 2021] DELETE /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:37:05.581229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.587029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.600962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.602086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.603106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.603770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.682115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.683256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.709405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.714213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.715061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.716380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.866606 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.877198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d6702bbc-1d12-4bd1-9408-9d47284a4a01 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.304055 Feb 17 04:37:05.877924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 224/447] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:05.905808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.906470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.914549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.915053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.915920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.916412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.150019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.173865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-24b4aaa8-34db-4609-8d5c-0a9325e9c9bb tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1504 microversion: 2.1 time: 0.260111 Feb 17 04:37:06.173865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 225/448] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:06.315220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.327223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.328925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.330168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3a99bd77-5a1a-459e-81d5-c6bc911ec9eb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1752 microversion: 2.20 time: 0.653435 Feb 17 04:37:06.331015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 224/449] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1752 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:06.896236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:06.896800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:06.905391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.905911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.906781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.907306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.144665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.155593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9eba9a78-838d-43f7-a999-51626b8cbaf4 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.263547 Feb 17 04:37:07.156229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 226/450] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:06 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:07.182286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:07.183454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.192441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.199020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.199020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.199020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.269324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d9b51e58-0e9d-4239-88ee-94eabee07af5 req-68d744e1-492d-48cd-ba70-dcc31b118700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204358c6-0e55-43d0-9716-3a5e4232673c", "name": "network-vif-deleted", "tag": "fc869d8b-0fc9-4051-9ff9-d664363c0879"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:07.271310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:07.271310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:07.281142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d9b51e58-0e9d-4239-88ee-94eabee07af5 req-68d744e1-492d-48cd-ba70-dcc31b118700 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.281639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d9b51e58-0e9d-4239-88ee-94eabee07af5 req-68d744e1-492d-48cd-ba70-dcc31b118700 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.300890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d9b51e58-0e9d-4239-88ee-94eabee07af5 req-68d744e1-492d-48cd-ba70-dcc31b118700 service nova] Creating event network-vif-deleted:fc869d8b-0fc9-4051-9ff9-d664363c0879 for instance 204358c6-0e55-43d0-9716-3a5e4232673c on hv-cinder-75995 Feb 17 04:37:07.306332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d9b51e58-0e9d-4239-88ee-94eabee07af5 req-68d744e1-492d-48cd-ba70-dcc31b118700 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041384 Feb 17 04:37:07.306990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 227/451] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:07.358210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:07.359677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.378734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.379637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.381129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.381977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.519525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980b70ffb35940bea61a77850e703190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5defbe82e641678f7511f3f14fefbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.528520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0c8fd33d-572d-4953-9a49-11092cc38490 tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 200 len: 1462 microversion: 2.1 time: 0.350477 Feb 17 04:37:07.529375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 225/452] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:07 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 1462 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:07.837202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "825c8721-32f8-47da-8485-62fc9ec5e2a0"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:07.838696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.853048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.854641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.856601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.857326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.934147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.954032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.955980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.959267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2ee04eb0-bbfb-468b-8efb-13114cd75fff tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.610780 Feb 17 04:37:07.973212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 228/453] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:07 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:08.175553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:08.179532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:08.212505 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.213029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.213917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.217325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.577269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:08.592911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-09d6c89d-63f5-499a-939d-958e68127438 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.421807 Feb 17 04:37:08.602916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 229/454] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:08 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:08.602916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:08.602916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] [instance: 204358c6-0e55-43d0-9716-3a5e4232673c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:08.612616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.613122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.613967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.614978 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.729285 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] HTTP exception thrown: Instance 204358c6-0e55-43d0-9716-3a5e4232673c could not be found. Feb 17 04:37:08.730049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] Returning 404 to user: Instance 204358c6-0e55-43d0-9716-3a5e4232673c could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:08.731565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-782436f8-a219-4767-9a4f-69877f27a4df tempest-VolumesActionsTest-286899114 tempest-VolumesActionsTest-286899114-project] 10.222.0.73 "GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c" status: 404 len: 111 microversion: 2.1 time: 0.136518 Feb 17 04:37:08.732201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 230/455] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:08 2021] GET /compute/v2.1/servers/204358c6-0e55-43d0-9716-3a5e4232673c => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:37:09.131222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:09.131222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:09.131222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.131222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.132986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.132986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.173961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c3c17245-cfa8-4f76-a1c1-284847b00b40 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.340910 Feb 17 04:37:09.181085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 226/456] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:37:07 2021] POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 194 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:09.323888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.336738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.338683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.340813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ebb69709-67a6-4e88-8e7b-e4b28879df81 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.364389 Feb 17 04:37:09.341616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 231/457] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:08 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:09.409843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-1cbeca73-4ea8-4104-b89f-b2fbccac8bfb req-e6eaf070-0cf5-43ba-926a-b2c229783b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1b30cc-269e-4de0-af2c-4e4b530decbd", "name": "network-vif-unplugged", "status": "completed", "tag": "80762b6b-ff48-48a7-b0f1-5e9fbb1583c0"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:09.413615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:09.413615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:09.459056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-1cbeca73-4ea8-4104-b89f-b2fbccac8bfb req-e6eaf070-0cf5-43ba-926a-b2c229783b2f service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.459056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-1cbeca73-4ea8-4104-b89f-b2fbccac8bfb req-e6eaf070-0cf5-43ba-926a-b2c229783b2f service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.460816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-1cbeca73-4ea8-4104-b89f-b2fbccac8bfb req-e6eaf070-0cf5-43ba-926a-b2c229783b2f service nova] Creating event network-vif-unplugged:80762b6b-ff48-48a7-b0f1-5e9fbb1583c0 for instance aa1b30cc-269e-4de0-af2c-4e4b530decbd on hv-cinder-75995 Feb 17 04:37:09.467044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-1cbeca73-4ea8-4104-b89f-b2fbccac8bfb req-e6eaf070-0cf5-43ba-926a-b2c229783b2f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062925 Feb 17 04:37:09.475397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 227/458] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:09.613071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:09.613743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:09.631920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.632504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.637373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.637895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.983462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.995179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-68ac005a-7cef-4cbd-bda0-29bfe3af43ac tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.387425 Feb 17 04:37:09.997028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 232/459] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:09 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:10.365467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:10.367004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:10.397585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.398452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.399888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.400589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.860318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.873273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.880432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.883518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ab888ce3-a3b2-4b5e-99b4-49db36f926a4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.524214 Feb 17 04:37:10.884930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 228/460] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:10 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:11.019337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:11.021292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:11.037478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.038154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.039135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.039725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.448286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:11.459123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-353618b3-7aa3-4af2-ac02-bf24784268e7 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.448514 Feb 17 04:37:11.464633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 233/461] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:11 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:11.915079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:11.915991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:11.926408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.926915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.927813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.928298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:12.318664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.330413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.332313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.333692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f2725ab5-425d-45a8-a432-cd0dddd31633 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.422984 Feb 17 04:37:12.341200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 229/462] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:11 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:12.479177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:12.479881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:12.489955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:12.490729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:12.491975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:12.492863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:12.856246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.894014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e3d1d2a5-ec7a-4d54-a695-05ca79116507 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.403096 Feb 17 04:37:12.895058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 234/463] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:12 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:13.355145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:13.356747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:13.366405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.367034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.368239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.368952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.685730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.719800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.723122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.724515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-98ec6d2a-74f7-431e-a1cb-615b06d6bd85 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.373757 Feb 17 04:37:13.725064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 230/464] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:13 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:13.917648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:13.918326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:13.926384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.926882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.927783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.928326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.347131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.362067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-47b2e4fb-ec9d-43a3-97bf-0320117b8433 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.448816 Feb 17 04:37:14.363643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 235/465] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:13 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:14.744527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:14.745391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:14.757892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.786987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.786987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.786987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.045969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.057178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.062576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.063844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-bb963987-f0d0-4498-b827-cae7292524b7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.323825 Feb 17 04:37:15.064442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 231/466] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:14 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:15.382655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:15.383581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:15.392442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.393039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.394070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.394575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.838946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.854130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e3d6b426-90cf-4275-8f5e-bd7203541092 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 0.475726 Feb 17 04:37:15.855919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 236/467] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:15 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:16.087906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:16.088760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:16.097861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.098699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.099782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.100470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.484150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.497921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.499889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.511443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-52cffce3-d8d1-4abb-859d-dfcbbb800cb8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.430969 Feb 17 04:37:16.524208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 232/468] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:16 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:16.876995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:16.878792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:16.894683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.895729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.896893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.897701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:17.532730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:17.533400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:17.562348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:17.564843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:17.566069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:17.567222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.067248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.082007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.083783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.085013 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8219a5a2-b5dc-4c61-9a74-799d9e2cba72 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.556740 Feb 17 04:37:18.085606 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 233/469] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:17 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:18.441023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.466457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8cfa098c-61f8-4e6e-86b8-0cfe1575d607 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 1.590959 Feb 17 04:37:18.472059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 237/470] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:16 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:19.107771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:19.108646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:19.135566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.136840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.137746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.138252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.490962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:19.492065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:19.510384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.515798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.517836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.519410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:20.076461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.082809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.090542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.095967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-eeb9055f-7e79-410a-96e4-7918b0a36bd3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.993665 Feb 17 04:37:20.097314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 234/471] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:19 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:20.587492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.607595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-86e923ac-8dba-4b2a-a048-846053b36af9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1508 microversion: 2.1 time: 1.121629 Feb 17 04:37:20.608213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 238/472] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:19 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1508 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:20.933439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:37:20.933668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:37:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:37:21.120801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:21.121464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:21.129533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.130085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.131053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.131454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.631300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:21.631970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:21.668406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.674955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.676117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.685038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:22.227573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.251590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.253575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.255551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3e293d66-1d00-4185-80a7-114a0ab8bcd0 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 1.139120 Feb 17 04:37:22.266276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 235/473] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:21 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:22.529777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-3d473096-da9b-4026-b6b5-e6ce053904a6 req-26dce1a1-caad-4866-a0c6-cec107067127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1b30cc-269e-4de0-af2c-4e4b530decbd", "name": "network-vif-deleted", "tag": "80762b6b-ff48-48a7-b0f1-5e9fbb1583c0"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:22.550683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:22.550683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:22.574232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3d473096-da9b-4026-b6b5-e6ce053904a6 req-26dce1a1-caad-4866-a0c6-cec107067127 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:22.579126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3d473096-da9b-4026-b6b5-e6ce053904a6 req-26dce1a1-caad-4866-a0c6-cec107067127 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:22.633831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-3d473096-da9b-4026-b6b5-e6ce053904a6 req-26dce1a1-caad-4866-a0c6-cec107067127 service nova] Creating event network-vif-deleted:80762b6b-ff48-48a7-b0f1-5e9fbb1583c0 for instance aa1b30cc-269e-4de0-af2c-4e4b530decbd on hv-cinder-75995 Feb 17 04:37:22.645068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-3d473096-da9b-4026-b6b5-e6ce053904a6 req-26dce1a1-caad-4866-a0c6-cec107067127 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123163 Feb 17 04:37:22.646390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 236/474] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:22.776658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.806504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5ed189ad-f63c-4236-90c3-0f6f7cee02b8 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1466 microversion: 2.1 time: 1.181074 Feb 17 04:37:22.817639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 239/475] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:21 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1466 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:23.281109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:23.281905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.302838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.303412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.304319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.304831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.832170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.838154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:23.844123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.858664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.865066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.868080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.869474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.870830 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.871724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.873314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4ab91b9a-b231-4345-bff7-ba2cb6068fdb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.597744 Feb 17 04:37:23.875940 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 237/476] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:23 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:24.012257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:24.013199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:24.014566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lazy-loading 'fault' on Instance uuid aa1b30cc-269e-4de0-af2c-4e4b530decbd {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:24.116710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:24.129176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c569153a-43b4-4f6f-b2d6-e1cfd80d4d70 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 200 len: 1311 microversion: 2.1 time: 0.294666 Feb 17 04:37:24.135329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 240/477] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:23 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 1311 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:24.902525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:24.903448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:24.918324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:24.919241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:24.920530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:24.921426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.148036 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:25.149418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: aa1b30cc-269e-4de0-af2c-4e4b530decbd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:25.169462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.174433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.180097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.180968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.251446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:25.269514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:25.271459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:25.274223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-eecd80f9-1491-4a45-9e90-f65222748ff9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.375504 Feb 17 04:37:25.274223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 238/478] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:24 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:25.303767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] HTTP exception thrown: Instance aa1b30cc-269e-4de0-af2c-4e4b530decbd could not be found. Feb 17 04:37:25.304452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Returning 404 to user: Instance aa1b30cc-269e-4de0-af2c-4e4b530decbd could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:25.305475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-be602fa1-2713-4e77-be97-394103ccd7ba tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd" status: 404 len: 111 microversion: 2.1 time: 0.161635 Feb 17 04:37:25.306396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 241/479] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:25 2021] GET /compute/v2.1/servers/aa1b30cc-269e-4de0-af2c-4e4b530decbd => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:37:25.317774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:25.319107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:25.329123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.329762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.330916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.331686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.476395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:37:25.921153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1369600d-5f53-4ac9-a670-3b047d936094 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 204 len: 0 microversion: 2.1 time: 0.609076 Feb 17 04:37:25.921815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 239/480] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:25 2021] DELETE /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:37:25.934354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:25.943867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:25.956196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.957306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.959466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.960980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.300440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:26.301291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:26.310744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.311253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.312238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.312747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.893377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.910185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.912022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.917299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2e3428cd-857c-4430-9542-9820f9079de7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.619331 Feb 17 04:37:26.924483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 240/481] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:26 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:27.150796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:27.186288 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2fcdf0b4-19b8-4853-a955-85024296f784 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 1.259153 Feb 17 04:37:27.187961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 242/482] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:25 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:27.941108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:27.942675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:27.964346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.972503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.974152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.974832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.204766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:28.206237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:28.221706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:28.222233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.223139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:28.223676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.435859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:28.450415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:28.452262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:28.456160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-61d24089-9d83-4c7d-9801-ed21d552ae1c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.520806 Feb 17 04:37:28.457439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 241/483] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:27 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:28.889552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:28.919382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-10932bd4-07f1-4816-b0f9-4ed1910a42b9 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.714593 Feb 17 04:37:28.920280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 243/484] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:28 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:28.990919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:28.991728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:29.003326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.004030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.005076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.006121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.352347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.367240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-53a0ee2b-68d4-42b2-8ff5-29268f634ca6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1595 microversion: 2.1 time: 0.381834 Feb 17 04:37:29.368855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 242/485] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:28 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1595 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:29.386585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-df9889a1-313f-4bc7-a3b5-093e70ef510e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: .version_select at 0x7f9b2ff21158>, body: {"pool": null} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:29.477910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:29.478582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:29.493785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.494577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.496172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.496817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.824865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.836717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.839757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.847709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d383d14d-37b9-40d2-8b3d-44e017164627 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.373976 Feb 17 04:37:29.848981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 243/486] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:29 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:29.937684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:29.938715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:29.951660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.952747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.953844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.954538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.423183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:30.441054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4a5f46f9-9159-4b1a-9bc8-ff6df0c60512 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.507422 Feb 17 04:37:30.442385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 244/487] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:29 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:30.876363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:30.878168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:30.895157 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.896474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.898592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.899751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.195761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:31.207155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:31.208784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:31.210305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b810814e-5821-4e4e-b731-f21ab70109a3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.341088 Feb 17 04:37:31.210921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 245/488] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:30 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:31.462436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:31.463173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:31.480065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.480602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.481501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.482027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.839955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:31.874905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5d241d5e-902f-4616-a7a0-dabb7ebdc86a tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.416689 Feb 17 04:37:31.875619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 246/489] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:31 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:32.234977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:32.236025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:32.246862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.247790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.254491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.256488 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.691632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.718428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.744499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.745833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0eb7f836-e1cf-4ee4-9342-f8f921153619 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.518573 Feb 17 04:37:32.746652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 247/490] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:32 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:32.893109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:32.893706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:32.903847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.904365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.905230 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.905727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.875799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.888905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-73a837a9-e944-4288-97f9-ebbb65a7ec5f tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1523 microversion: 2.1 time: 0.999762 Feb 17 04:37:33.905527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 248/491] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:32 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1523 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:33.911076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:33.924315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:33.933035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.933976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.934994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.944406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.356236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-df9889a1-313f-4bc7-a3b5-093e70ef510e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.970314 Feb 17 04:37:34.356236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 244/492] 10.222.0.73 () {60 vars in 1160 bytes} [Wed Feb 17 04:37:29 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:34.366444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'action', calling method: .version_select at 0x7f9b3dea5ae8>, body: {"addFloatingIp": {"address": "172.27.2.189"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:34.367778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:34.391957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.392478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.393361 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.393884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.502977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Acquired lock "refresh_cache-f5312116-c2c7-4e67-a046-f48f4eea78fd" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:37:35.492307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:35.508745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:35.510459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:35.511837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9412550d-cd1f-48b8-935f-5408818c0948 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 1.604783 Feb 17 04:37:35.526661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 249/493] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:33 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:35.526661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-da49cfe1-e86f-42e4-b0dc-378154344905 req-b37e183c-7cba-4d7e-a79f-11b2104a6d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "name": "network-vif-plugged", "status": "completed", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:35.527346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:35.527346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:35.538066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-da49cfe1-e86f-42e4-b0dc-378154344905 req-b37e183c-7cba-4d7e-a79f-11b2104a6d61 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.538894 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-da49cfe1-e86f-42e4-b0dc-378154344905 req-b37e183c-7cba-4d7e-a79f-11b2104a6d61 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:35.581669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-da49cfe1-e86f-42e4-b0dc-378154344905 req-b37e183c-7cba-4d7e-a79f-11b2104a6d61 service nova] Creating event network-vif-plugged:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:37:35.591720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-da49cfe1-e86f-42e4-b0dc-378154344905 req-b37e183c-7cba-4d7e-a79f-11b2104a6d61 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067652 Feb 17 04:37:35.592768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 250/494] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:35.604560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:35.618494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:35.640868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.641786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:35.643060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.643886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.219465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eb5c69b27948cf9454ae54e9468204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e308712a7a343778981979df1c88348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.254221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fe4a8444-4465-4caa-a56b-6b62787a23da tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 200 len: 1307 microversion: 2.1 time: 0.649036 Feb 17 04:37:36.257151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 251/495] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:35 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 1307 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:36.272552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-069f387c-7a99-4fd8-a264-68b10d522c21 req-2e8134fa-02b8-4110-8c2c-b9623d4f5ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2641c971-9a8a-467c-92f1-1317f397e36f", "name": "network-vif-deleted", "tag": "0bf5f471-d184-4e72-bf60-7bbf55b896ba"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:36.281357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:36.281357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:36.302334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-069f387c-7a99-4fd8-a264-68b10d522c21 req-2e8134fa-02b8-4110-8c2c-b9623d4f5ecc service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.303933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-069f387c-7a99-4fd8-a264-68b10d522c21 req-2e8134fa-02b8-4110-8c2c-b9623d4f5ecc service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.336610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-069f387c-7a99-4fd8-a264-68b10d522c21 req-2e8134fa-02b8-4110-8c2c-b9623d4f5ecc service nova] Creating event network-vif-deleted:0bf5f471-d184-4e72-bf60-7bbf55b896ba for instance 2641c971-9a8a-467c-92f1-1317f397e36f on hv-cinder-75995 Feb 17 04:37:36.360633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-069f387c-7a99-4fd8-a264-68b10d522c21 req-2e8134fa-02b8-4110-8c2c-b9623d4f5ecc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091762 Feb 17 04:37:36.361477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 252/496] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:36.535865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:36.536691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:36.560911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.561836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.574861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.575859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.418421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.440841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.442515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.443784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8f30359c-06e2-41e3-af56-2e8ff8eaebfb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.914497 Feb 17 04:37:37.444630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 253/497] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:36 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:37.460939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:37.463738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] [instance: 2641c971-9a8a-467c-92f1-1317f397e36f] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:37.474670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.476821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.481583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.482412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.644206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] HTTP exception thrown: Instance 2641c971-9a8a-467c-92f1-1317f397e36f could not be found. Feb 17 04:37:37.664623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] Returning 404 to user: Instance 2641c971-9a8a-467c-92f1-1317f397e36f could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:37.670123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a2fb796e-ffc6-4fbd-b128-c50bda01f626 tempest-ServerRescueNegativeTestJSON-735056347 tempest-ServerRescueNegativeTestJSON-735056347-project] 10.222.0.73 "GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f" status: 404 len: 111 microversion: 2.1 time: 0.224039 Feb 17 04:37:37.681503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 254/498] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:37 2021] GET /compute/v2.1/servers/2641c971-9a8a-467c-92f1-1317f397e36f => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:37:38.477161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:38.478132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:38.499585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.500393 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.502005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.503163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:39.086642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.115913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.119066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.121898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-76005885-e1b9-41ef-9f11-62a2afe8c9ae tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.648290 Feb 17 04:37:39.127413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 255/499] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:38 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:40.142650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:40.143469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:40.160561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.161099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.161994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.162493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.673663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:40.695070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:40.701393 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:40.702768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c1a370cf-073a-4d88-ba24-9e3b82d26269 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1808 microversion: 2.20 time: 0.564398 Feb 17 04:37:40.703406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 256/500] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:40 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1808 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:40.762297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:37:40.762592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:37:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:37:41.045913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Building network info cache for instance {{(pid=98222) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:37:41.074982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b0bb0a1a-587a-46d0-b379-defcb27f9c85 req-df7dcf2d-aa23-457a-96ba-e793102a632a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:41.076748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:41.076748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:41.102757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b0bb0a1a-587a-46d0-b379-defcb27f9c85 req-df7dcf2d-aa23-457a-96ba-e793102a632a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:41.107709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b0bb0a1a-587a-46d0-b379-defcb27f9c85 req-df7dcf2d-aa23-457a-96ba-e793102a632a service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:41.202660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b0bb0a1a-587a-46d0-b379-defcb27f9c85 req-df7dcf2d-aa23-457a-96ba-e793102a632a service nova] Creating event network-changed:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:37:41.259715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b0bb0a1a-587a-46d0-b379-defcb27f9c85 req-df7dcf2d-aa23-457a-96ba-e793102a632a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167742 Feb 17 04:37:41.267116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 257/501] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:41.729734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:41.731115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:41.795936 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:41.796703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:41.804064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:41.821129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.568634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.586106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.595236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.601291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2acd0c8f-6d36-44b7-8f01-54a4acc72956 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1795 microversion: 2.20 time: 0.880939 Feb 17 04:37:42.606123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 258/502] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:41 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1795 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:44.883163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:44.884356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:44.906072 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.906953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.908129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.908832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.192565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lazy-loading 'services' on Instance uuid fe67c43f-82ea-4944-a563-9fed39d42080 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:45.576090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d8fc01d-daae-40f9-a317-5349f833bac9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/os-volume_attachments/4979c37f-83b5-4734-a90f-5c0b3e65268e" status: 202 len: 0 microversion: 2.1 time: 0.695273 Feb 17 04:37:45.583861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 259/503] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:37:44 2021] DELETE /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/os-volume_attachments/4979c37f-83b5-4734-a90f-5c0b3e65268e => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:37:46.837983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Updating instance_info_cache with network_info: [{"id": "e61721f8-ed25-4ebf-82cf-247999d61026", "address": "fa:16:3e:82:6d:e7", "network": {"id": "25653d82-43fa-4aa5-a3be-d27965409dd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1513509793-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "14187639adc74d1bb49ed835b238d04c", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tape61721f8-ed", "ovs_interfaceid": "e61721f8-ed25-4ebf-82cf-247999d61026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98222) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:37:46.847684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Releasing lock "refresh_cache-f5312116-c2c7-4e67-a046-f48f4eea78fd" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:37:46.848614 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-09c64105-d1ba-4f5d-85a9-725e8ea0e3f6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action" status: 202 len: 0 microversion: 2.1 time: 12.486376 Feb 17 04:37:46.849563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 245/504] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:34 2021] POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action => generated 0 bytes in 12488 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Feb 17 04:37:46.864463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b86ae80b-600c-4fcc-b046-b1104658649b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: .version_select at 0x7f9b3c0c8ea0>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1052747798", "description": "tempest-TestMinimumBasicScenario-1052747798 description"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:46.914330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-41b31280-c6f9-422a-93e3-c5d4938e4113 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:46.923861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-41b31280-c6f9-422a-93e3-c5d4938e4113 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.924374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-41b31280-c6f9-422a-93e3-c5d4938e4113 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.989680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-41b31280-c6f9-422a-93e3-c5d4938e4113 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Going to try to stop instance {{(pid=98222) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 04:37:47.191540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-41b31280-c6f9-422a-93e3-c5d4938e4113 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 202 len: 0 microversion: 2.1 time: 0.281490 Feb 17 04:37:47.192706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 246/505] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:46 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:37:47.208843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:47.210769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:47.229162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.229896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.232094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.233401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.327244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b86ae80b-600c-4fcc-b046-b1104658649b tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.471594 Feb 17 04:37:47.335560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 260/506] 10.222.0.73 () {60 vars in 1170 bytes} [Wed Feb 17 04:37:46 2021] POST /compute/v2.1/os-security-groups => generated 257 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:47.341377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1059a383-8454-4f9c-a22f-74b90feb4d1a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: .version_select at 0x7f9b3c0c89d8>, body: {"security_group_rule": {"parent_group_id": "c44920cf-8ce7-4304-aeb4-587c058b73cb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:47.779442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1059a383-8454-4f9c-a22f-74b90feb4d1a tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.442293 Feb 17 04:37:47.780176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 261/507] 10.222.0.73 () {60 vars in 1185 bytes} [Wed Feb 17 04:37:47 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:47.793847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4c38c8ac-ddf1-4ba2-90a7-a361b5164945 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'create', calling method: .version_select at 0x7f9b3db60510>, body: {"security_group_rule": {"parent_group_id": "c44920cf-8ce7-4304-aeb4-587c058b73cb", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:47.957459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:47.968612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0657f50a-a9cb-4d6d-b24e-e3da0f57e258 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1677 microversion: 2.1 time: 0.769758 Feb 17 04:37:47.969380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 247/508] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:47 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1677 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:48.208997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4c38c8ac-ddf1-4ba2-90a7-a361b5164945 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.421726 Feb 17 04:37:48.209883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 262/509] 10.222.0.73 () {60 vars in 1185 bytes} [Wed Feb 17 04:37:47 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:48.222558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1052747798"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:48.223147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:48.231548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.232008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.232988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.233490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.646921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.network.security_group_api [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Adding security group c44920cf-8ce7-4304-aeb4-587c058b73cb to port e61721f8-ed25-4ebf-82cf-247999d61026 Feb 17 04:37:48.988523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:48.989942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:49.002814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.003732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.005383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.006084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.515854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.531626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8b731d01-40af-4f7b-9565-f8566b851921 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1677 microversion: 2.1 time: 0.546820 Feb 17 04:37:49.532896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 263/510] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:48 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1677 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:50.551448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.552281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.572300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.572828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.573718 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.574213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.839950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dc6bce71-05b9-44c9-b79c-f4d5ed610b36 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action" status: 202 len: 0 microversion: 2.1 time: 2.621682 Feb 17 04:37:50.843776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 248/511] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:48 2021] POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action => generated 0 bytes in 2623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:50.850150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.851720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.876363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.877175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.879553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.883035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.305289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.327317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-189686b9-0a18-4f76-8fcd-98a92f650d5e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1677 microversion: 2.1 time: 0.777773 Feb 17 04:37:51.327317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 264/512] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1677 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:51.348472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-afff0d88-3fd2-428b-8eea-2ddd393e387b req-0dc0b3ed-e7a4-40be-8d7c-e9e5c6603888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:51.350409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:51.350409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:37:51.370022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-afff0d88-3fd2-428b-8eea-2ddd393e387b req-0dc0b3ed-e7a4-40be-8d7c-e9e5c6603888 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.370367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-afff0d88-3fd2-428b-8eea-2ddd393e387b req-0dc0b3ed-e7a4-40be-8d7c-e9e5c6603888 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.398774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-afff0d88-3fd2-428b-8eea-2ddd393e387b req-0dc0b3ed-e7a4-40be-8d7c-e9e5c6603888 service nova] Creating event network-changed:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:37:51.404688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-afff0d88-3fd2-428b-8eea-2ddd393e387b req-0dc0b3ed-e7a4-40be-8d7c-e9e5c6603888 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069351 Feb 17 04:37:51.405340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 265/513] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:51.590727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.601800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1c3e9995-6912-472f-9b7f-0ded6e9a6744 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1771 microversion: 2.1 time: 0.754969 Feb 17 04:37:51.601800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 249/514] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1771 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:51.987684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:51.990036 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.006356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.006853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.007939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.010198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.345496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:52.347959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.369791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.370490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.371708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.372431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.388569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c11ada9a-ab92-4fcf-8362-7866266a09c6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action" status: 202 len: 0 microversion: 2.1 time: 0.405232 Feb 17 04:37:52.389565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 266/515] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:51 2021] POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:52.408571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:52.411132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.445160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.446028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.448340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.449136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.158164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:53.175997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-851d683b-8c00-47d3-93c5-2e9c53a42f63 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1677 microversion: 2.1 time: 0.835819 Feb 17 04:37:53.176944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 250/516] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:52 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1677 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:53.710566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:53.722574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3570dd77-95dc-467f-ad1f-3a7a1fc11278 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1763 microversion: 2.1 time: 1.324898 Feb 17 04:37:53.723454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 267/517] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:52 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1763 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:54.196001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:54.197434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.206919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.217118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.218311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.219148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.742709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:54.743960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.753278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.754179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.755229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.755766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.093479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:55.102823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a9da9b68-c045-4088-872d-3d3ea4f03777 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1677 microversion: 2.1 time: 0.911005 Feb 17 04:37:55.103666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 251/518] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:54 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1677 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:55.321746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:55.340804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e09b7ccd-8e8c-4953-b229-4f30ede65687 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1763 microversion: 2.1 time: 0.601962 Feb 17 04:37:55.341944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 268/519] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:54 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1763 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:55.678181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2a51e274-43cd-449b-abaa-71676aee1240 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'create', calling method: .version_select at 0x7f9b2ff212f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-530059094"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:55.727019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-2a51e274-43cd-449b-abaa-71676aee1240 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Getting quotas for project d447f221703e4725a470bab1096716e0. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:37:55.733316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-2a51e274-43cd-449b-abaa-71676aee1240 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Getting quotas for user c35be49abea3449ea8d25e8e83ccc8de and project d447f221703e4725a470bab1096716e0. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:37:56.124974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.125956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:56.153108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.157616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.157616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.160077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.205038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-2a51e274-43cd-449b-abaa-71676aee1240 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Getting quotas for project d447f221703e4725a470bab1096716e0. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:37:56.210583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-2a51e274-43cd-449b-abaa-71676aee1240 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Getting quotas for user c35be49abea3449ea8d25e8e83ccc8de and project d447f221703e4725a470bab1096716e0. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:37:56.250812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2a51e274-43cd-449b-abaa-71676aee1240 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.951665 Feb 17 04:37:56.257234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 252/520] 10.222.0.73 () {60 vars in 1148 bytes} [Wed Feb 17 04:37:55 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:56.262974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6c85df83-ba88-49e6-96cc-7964ff91f2be tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'create', calling method: .version_select at 0x7f9b2ff21ea0>, body: {"security_group": {"name": "tempest-TestShelveInstance-610725440", "description": "tempest-TestShelveInstance-610725440 description"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:56.738405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:56.756596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fca7c8bb-299c-4d78-8d8d-ca73f7364514 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1677 microversion: 2.1 time: 0.638005 Feb 17 04:37:56.761016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 269/521] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1677 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:56.777552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.778823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:56.800030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.802262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.804275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.807069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.919174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6c85df83-ba88-49e6-96cc-7964ff91f2be tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.660604 Feb 17 04:37:56.919948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 253/522] 10.222.0.73 () {60 vars in 1170 bytes} [Wed Feb 17 04:37:56 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:56.932378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-390c3d5a-2535-4eed-80f0-325923c9fd4a tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'create', calling method: .version_select at 0x7f9b2ff21b70>, body: {"security_group_rule": {"parent_group_id": "7c192d6c-d625-4515-ab61-65b63dde532c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:57.302659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:57.329237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b9083c0a-467e-4aa9-a826-4d44d26d93c4 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.561408 Feb 17 04:37:57.330838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 270/523] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:57.402847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-390c3d5a-2535-4eed-80f0-325923c9fd4a tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.474967 Feb 17 04:37:57.403722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 254/524] 10.222.0.73 () {60 vars in 1185 bytes} [Wed Feb 17 04:37:56 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:57.421867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fe1ba35c-01d7-4e6c-aa0f-563e1d340c80 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'create', calling method: .version_select at 0x7f9b2feb2bf8>, body: {"security_group_rule": {"parent_group_id": "7c192d6c-d625-4515-ab61-65b63dde532c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:57.781273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.868144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:57.868144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.868144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.868144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.869051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.057002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:58.079200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-049a80d4-e995-46b6-9fcc-52031bbb8ab5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1654 microversion: 2.1 time: 0.290538 Feb 17 04:37:58.079200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 255/525] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1654 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:58.084971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d0df8651-662c-4961-b5e2-13448f3ac399 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:58.093362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d0df8651-662c-4961-b5e2-13448f3ac399 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.093877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d0df8651-662c-4961-b5e2-13448f3ac399 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.125078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fe1ba35c-01d7-4e6c-aa0f-563e1d340c80 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.713120 Feb 17 04:37:58.126451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 271/526] 10.222.0.73 () {60 vars in 1185 bytes} [Wed Feb 17 04:37:57 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:58.165696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d0df8651-662c-4961-b5e2-13448f3ac399 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Going to try to start instance {{(pid=98222) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 04:37:58.355843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:58.356974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.358548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d0df8651-662c-4961-b5e2-13448f3ac399 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action" status: 202 len: 0 microversion: 2.1 time: 0.277117 Feb 17 04:37:58.364270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 256/527] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:58 2021] POST /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:37:58.378597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:58.379770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.384719 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.386007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.387224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.394113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.403727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.404237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.405073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.405740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.007903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:59.018401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-edbe302d-7e15-4e5d-b47c-de08ef15f1e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1663 microversion: 2.1 time: 0.652406 Feb 17 04:37:59.038688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 257/528] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:58 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1663 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:59.049263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:59.059653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d85e5cf-63a3-45c6-a943-600b06991144 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.710003 Feb 17 04:37:59.060283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 272/529] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:58 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:00.036823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:00.038348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.061639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.061639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.061639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.061639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.079075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:00.079743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.100250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.101100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.102148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.102825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.513414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:00.525070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6155b454-4f80-47e6-a464-738819c6f323 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.450226 Feb 17 04:38:00.526246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 273/530] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:00 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:00.681151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:00.693857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8ee560f7-9b67-4cb7-9851-1706f8e5c69d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1663 microversion: 2.1 time: 0.660910 Feb 17 04:38:00.695571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 258/531] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:00 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1663 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:01.544749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.545437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.554668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.555039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.556478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.556964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.807482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.807482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.807482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.807482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.811069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.811069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.943408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:01.955439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7f9da95f-c2f0-4827-8195-3008b94dd6a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.414448 Feb 17 04:38:01.956073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 274/532] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:01 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:02.178745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:02.189658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-693eed71-7c7c-41e5-98dc-5547d41e61fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1667 microversion: 2.1 time: 0.479518 Feb 17 04:38:02.190402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 259/533] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:01 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1667 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:02.860399 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-517859054", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "373accc4-7a29-4586-831f-494c09eed7f5"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:02.931082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] validate_networks() for [('373accc4-7a29-4586-831f-494c09eed7f5', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:02.985830 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:02.987071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:02.995724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.996246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.997123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.997620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.244630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.254949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5dc41f6e-4bfc-4477-8da2-32a83b00e57e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.273349 Feb 17 04:38:03.255600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 260/534] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:02 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:03.713747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:03.714534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:03.715086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:03.715665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:03.716161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:03.725635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.726148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.727028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.727691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.750577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:03.760478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for user dc1261a734684bc6bfde7bb9395be18c and project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:03.769815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:03.772434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:03.856672 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c4316e42-8197-4ca5-8443-81589525c916 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151007 Feb 17 04:38:03.857388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 275/535] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:03.869098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-97836ef1-629d-4585-ae2c-d0a596b7312a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:03.869771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-97836ef1-629d-4585-ae2c-d0a596b7312a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:03.958319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-97836ef1-629d-4585-ae2c-d0a596b7312a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.968197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-97836ef1-629d-4585-ae2c-d0a596b7312a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1217 microversion: 2.1 time: 0.103882 Feb 17 04:38:03.971349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 261/536] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:03 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:04.274116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:04.274786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:04.283567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.284204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.285379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.286086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.521721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:04.533779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a091acc2-b66a-40a8-8fb9-ed8949425d22 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.263616 Feb 17 04:38:04.536773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 276/537] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:04 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:04.987703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:04.988378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:04.997044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.997573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.998458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.998963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.135921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.144831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-694ef4d0-33f1-4c5d-9027-d5d5aa12ef8e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1221 microversion: 2.1 time: 0.161368 Feb 17 04:38:05.145637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 262/538] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:04 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:05.553312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:05.553982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:05.563144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.563684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.564552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.565050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.822535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.832439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a030ee36-4af9-43ed-b6e2-e4bd11f0823f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.283268 Feb 17 04:38:05.833050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 277/539] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:05 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:06.162634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:06.163263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:06.172631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.173140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.174127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.174621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.306249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:06.317943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b3b908f7-ad76-4f80-8dcf-d26065e39690 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1277 microversion: 2.1 time: 0.157241 Feb 17 04:38:06.318704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 263/540] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:06 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:06.850781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:06.851481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:06.859234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.859807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.860648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.861145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.252507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:07.262141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f9529513-e587-43cd-b7be-45410f8603c8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.415489 Feb 17 04:38:07.262745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 278/541] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:06 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:07.340181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:07.340862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:07.349208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.349735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.350902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.351578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.701143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:07.712715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4830c12d-52e8-4941-a8c0-4d4cbcb55e34 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.376548 Feb 17 04:38:07.713346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 264/542] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:07 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:08.281506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:08.282132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:08.291610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.295943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.297017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.297755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.698377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:08.716047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a98004b9-72dc-4cfe-aefa-4dd513e74c0c tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.434504 Feb 17 04:38:08.716047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 279/543] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:08 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:08.737754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:08.738913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:08.754038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.754888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.756358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.757184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.143998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:09.154253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6a5c38cb-b0fe-4193-8970-5753ab706870 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.424058 Feb 17 04:38:09.154805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 265/544] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:08 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:09.536039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-0cef7db4-798b-47fc-b625-9cd7f1b40dc0 req-501bdb6f-c938-49b9-8ff4-78973e8bc6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0da21aa-1ab0-4752-b15a-194a6de5adf8", "tag": "8600f1f1-a316-4a18-a5ae-51e52c74e16e"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:09.537788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:09.537788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:09.546947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0cef7db4-798b-47fc-b625-9cd7f1b40dc0 req-501bdb6f-c938-49b9-8ff4-78973e8bc6df service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.547507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0cef7db4-798b-47fc-b625-9cd7f1b40dc0 req-501bdb6f-c938-49b9-8ff4-78973e8bc6df service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.565085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-0cef7db4-798b-47fc-b625-9cd7f1b40dc0 req-501bdb6f-c938-49b9-8ff4-78973e8bc6df service nova] Creating event network-changed:8600f1f1-a316-4a18-a5ae-51e52c74e16e for instance d0da21aa-1ab0-4752-b15a-194a6de5adf8 on hv-cinder-75995 Feb 17 04:38:09.570069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-0cef7db4-798b-47fc-b625-9cd7f1b40dc0 req-501bdb6f-c938-49b9-8ff4-78973e8bc6df service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038077 Feb 17 04:38:09.570727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 280/545] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:38:09.737095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:09.737660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:09.751748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.752371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.753941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.754573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.996638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:10.007953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a8ab9962-9ace-4e00-bb8d-3c61d45f3043 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.275433 Feb 17 04:38:10.008865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 266/546] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:09 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:10.174105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:10.174883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:10.183930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.184467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.185322 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.185820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.722244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:10.732209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9d2180c6-aeac-4f98-a46c-839459d25b13 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.563626 Feb 17 04:38:10.732820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 281/547] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:10 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:11.028111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:11.028776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:11.036800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.037308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.038158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.038652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.260921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:11.270565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3c23b414-1a8b-4eb1-973c-8a9a4648db63 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.247167 Feb 17 04:38:11.271174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 267/548] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:11 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:11.750663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:11.751374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:11.759149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.759686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.760522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.761014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.971531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:11.981330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c27f7188-3828-4041-b34e-713b0064bbbe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.234831 Feb 17 04:38:11.981930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 282/549] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:11 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:12.289201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:12.290097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:12.297988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:12.298500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.299364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:12.299861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.511730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:12.521233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c90b7738-036b-4bb1-94fb-12fd89698030 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1768 microversion: 2.1 time: 0.236224 Feb 17 04:38:12.521838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 268/550] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:12 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1768 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:13.000241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:13.000835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.008641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.009146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.009980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.010474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.227403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:13.236198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e49a0749-41d3-4862-b2b4-a7f3708a97d1 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.240144 Feb 17 04:38:13.236765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 283/551] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:12 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:13.541628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:13.542302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.550333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.550838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.551734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.552235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.767434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:13.777410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-326604df-6dc7-4348-af72-5b9e5b342dba tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1771 microversion: 2.1 time: 0.241196 Feb 17 04:38:13.777946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 269/552] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:13 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1771 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:14.254710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:14.255416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:14.263400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.263916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.264811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.265311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.484260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:14.501628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fde5435f-c15c-4a6d-84bb-f44e06c8ca95 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.250861 Feb 17 04:38:14.502245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 284/553] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:14 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:14.633944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d43f30be-6550-411f-b6f1-5387d888019a req-ff51ea70-4c4a-4807-bcc6-c13d85691a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0da21aa-1ab0-4752-b15a-194a6de5adf8", "name": "network-vif-plugged", "status": "completed", "tag": "8600f1f1-a316-4a18-a5ae-51e52c74e16e"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:14.635861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:14.635861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:14.645089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d43f30be-6550-411f-b6f1-5387d888019a req-ff51ea70-4c4a-4807-bcc6-c13d85691a71 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.645660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d43f30be-6550-411f-b6f1-5387d888019a req-ff51ea70-4c4a-4807-bcc6-c13d85691a71 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.665958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d43f30be-6550-411f-b6f1-5387d888019a req-ff51ea70-4c4a-4807-bcc6-c13d85691a71 service nova] Creating event network-vif-plugged:8600f1f1-a316-4a18-a5ae-51e52c74e16e for instance d0da21aa-1ab0-4752-b15a-194a6de5adf8 on hv-cinder-75995 Feb 17 04:38:14.671480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d43f30be-6550-411f-b6f1-5387d888019a req-ff51ea70-4c4a-4807-bcc6-c13d85691a71 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041926 Feb 17 04:38:14.672219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 270/554] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:15.520571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:15.521366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:15.529933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.530544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.531432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.531919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.770388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:15.779777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3edc1091-fca9-4e3e-acdb-afb7829e04be tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1317 microversion: 2.1 time: 0.263294 Feb 17 04:38:15.780392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 285/555] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:15 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:16.433044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-814168121", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-530059094", "security_groups": [{"name": "tempest-TestShelveInstance-610725440"}], "networks": [{"uuid": "1e85d977-59c3-4c3c-9bba-18bb58ffd3cd"}], "block_device_mapping_v2": [{"uuid": "e170dcec-ef76-4b96-8744-8dfc341c63fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:16.703723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] validate_networks() for [('1e85d977-59c3-4c3c-9bba-18bb58ffd3cd', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:16.798255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:16.798956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:16.806827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.807355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.808193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.808680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.036965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:17.047340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-62be8cc3-661f-40f8-ba73-04902018bd41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1506 microversion: 2.1 time: 0.252887 Feb 17 04:38:17.047970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 286/556] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:16 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:17.592734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:17.593224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:17.593782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:17.594242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:17.594792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:17.612454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.623752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.625428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.626465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.663300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Getting quotas for project d447f221703e4725a470bab1096716e0. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:17.668348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Getting quotas for user c35be49abea3449ea8d25e8e83ccc8de and project d447f221703e4725a470bab1096716e0. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:17.782623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:17.785457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e170dcec-ef76-4b96-8744-8dfc341c63fd',volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:18.123109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2aaa6c54-fbff-4581-83b3-56a0f8c97ba3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.694702 Feb 17 04:38:18.123860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 271/557] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:16 2021] POST /compute/v2.1/servers => generated 409 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:38:18.134593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7755b298-ea68-4b37-8e53-371ab5ae5565 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:18.135265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7755b298-ea68-4b37-8e53-371ab5ae5565 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:18.214549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7755b298-ea68-4b37-8e53-371ab5ae5565 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:18.224330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7755b298-ea68-4b37-8e53-371ab5ae5565 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1087 microversion: 2.1 time: 0.093693 Feb 17 04:38:18.224961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 287/558] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:18 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1087 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:18.839613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fbd3bb4-58c6-4642-8bd2-a397d7a1ccb2"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:18.840880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:18.853079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.853583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.854436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.854927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.243467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:19.244054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:19.252012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.252524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.253364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.253857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.381297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:19.390635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3d1782a7-9ae0-42e6-bdff-6d26d3fa76a0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1185 microversion: 2.1 time: 0.151788 Feb 17 04:38:19.391296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 288/559] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:19 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:19.477390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-09d3d81e-4d0f-4eff-a876-f2b7ed9507fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642222 Feb 17 04:38:19.478060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 272/560] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:38:18 2021] POST /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:20.409508 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:20.410319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:20.419925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.420548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.421501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.422069 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.565082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:20.576057 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-895750df-3c45-42c7-b7dc-6abb88af35ef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1203 microversion: 2.1 time: 0.170676 Feb 17 04:38:20.576875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 289/561] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:20 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:21.411366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:21.412175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:21.421629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.422139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.423002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.423526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.492884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0916505b-f444-4649-8cb9-f406dd97fcc4 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-volume_attachments/066805b7-5b7f-4972-8ce7-93b216dfa7d3" status: 200 len: 194 microversion: 2.20 time: 0.086784 Feb 17 04:38:21.493562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 273/562] 10.222.0.73 () {60 vars in 1444 bytes} [Wed Feb 17 04:38:21 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-volume_attachments/066805b7-5b7f-4972-8ce7-93b216dfa7d3 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:21.598845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:21.599526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:21.612848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.612848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.612848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.612848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.631763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:21.632323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:21.641212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.641742 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.642630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.643129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.856113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lazy-loading 'services' on Instance uuid a076d3cd-b9c1-4802-bdae-3941d4348e7c {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:22.102555 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cb9477ad-cedb-414f-b428-324a4d7155e1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-volume_attachments/066805b7-5b7f-4972-8ce7-93b216dfa7d3" status: 202 len: 0 microversion: 2.20 time: 0.474097 Feb 17 04:38:22.103134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 274/563] 10.222.0.73 () {60 vars in 1447 bytes} [Wed Feb 17 04:38:21 2021] DELETE /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c/os-volume_attachments/066805b7-5b7f-4972-8ce7-93b216dfa7d3 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:38:22.144958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:22.154016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ecb980f8-2cd9-466c-bbd1-4487779078a8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1274 microversion: 2.1 time: 0.559150 Feb 17 04:38:22.154629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 290/564] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:21 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1274 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:23.173881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:23.174653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:23.183181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.183714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.184551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.185042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.431272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:23.440225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-817f2dbd-6bbf-46cc-b71f-80d2f7e35e23 req-ff95e044-a16a-4bb8-a200-bfabd45ef194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:23.441184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e2c23b99-2688-4dcc-b827-606f73ce89b3 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1274 microversion: 2.1 time: 0.271711 Feb 17 04:38:23.442290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 275/565] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:23 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:23.444007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:23.444007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:23.460552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-817f2dbd-6bbf-46cc-b71f-80d2f7e35e23 req-ff95e044-a16a-4bb8-a200-bfabd45ef194 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.461311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-817f2dbd-6bbf-46cc-b71f-80d2f7e35e23 req-ff95e044-a16a-4bb8-a200-bfabd45ef194 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.484836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-817f2dbd-6bbf-46cc-b71f-80d2f7e35e23 req-ff95e044-a16a-4bb8-a200-bfabd45ef194 service nova] Creating event network-changed:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:38:23.490367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-817f2dbd-6bbf-46cc-b71f-80d2f7e35e23 req-ff95e044-a16a-4bb8-a200-bfabd45ef194 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058031 Feb 17 04:38:23.490810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 291/566] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:38:24.470427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:24.471095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:24.479381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:24.479909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:24.480751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:24.481244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:24.703949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:24.713008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d1fdd133-903e-4196-a4f0-9d9314176a0e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1274 microversion: 2.1 time: 0.246535 Feb 17 04:38:24.713596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 276/567] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:24 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:25.731649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:25.732346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:25.740747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.741265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.742113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.742635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.963951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:25.973870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-60b0fe12-009a-42da-89ac-b17fc9c7fbee tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1274 microversion: 2.1 time: 0.246991 Feb 17 04:38:25.974667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 292/568] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:25 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:26.992542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:26.993982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:27.001335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.001843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.002700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.003196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.218860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:27.227910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-73fa3973-6520-4bec-8ae0-33afb885bc5b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1274 microversion: 2.1 time: 0.240119 Feb 17 04:38:27.228523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 277/569] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:26 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:27.514538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2045202906", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "373accc4-7a29-4586-831f-494c09eed7f5"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:27.661202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] validate_networks() for [('373accc4-7a29-4586-831f-494c09eed7f5', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:28.246579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:28.247438 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:28.256865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.257883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.258764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.259261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.438189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:28.438683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:28.439215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:28.439715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:28.440178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:28.449864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.450369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.451244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.451803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.470640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:28.475007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for user dc1261a734684bc6bfde7bb9395be18c and project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:28.483705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:28.486532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:28.489343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:28.494652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-30f2b1fb-5da1-4b5e-be74-ca8827bbceea tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.252345 Feb 17 04:38:28.495331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 278/570] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:28 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:28.701227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-49b3d2da-a34a-473a-b0f6-25ce82a466b4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198207 Feb 17 04:38:28.701952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 293/571] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:28.712942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6f1ac920-7231-457a-86e5-e895211b50e3 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:28.713740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6f1ac920-7231-457a-86e5-e895211b50e3 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:28.803637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6f1ac920-7231-457a-86e5-e895211b50e3 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:28.813283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6f1ac920-7231-457a-86e5-e895211b50e3 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1218 microversion: 2.1 time: 0.104396 Feb 17 04:38:28.814083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 279/572] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:28 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:28.924441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:28.928363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:28.941009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.941575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.942428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.942921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.011656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:38:29.370746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fdee28e1-2c11-4f07-a094-cae4e4997336 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 204 len: 0 microversion: 2.20 time: 0.453914 Feb 17 04:38:29.371431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 294/573] 10.222.0.73 () {60 vars in 1270 bytes} [Wed Feb 17 04:38:28 2021] DELETE /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:38:29.380500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:29.381160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:29.389129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.389638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.390475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.390965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.517272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:29.518415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:29.528888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.529443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.530265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.530767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.628790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:29.640710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:29.642515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:29.644007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2585867c-4a3f-4ba6-9bdf-cb0a9ee1831f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.267753 Feb 17 04:38:29.644784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 280/574] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:29 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:38:29.764054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:29.773682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dcf4bf49-33a7-4c89-bfef-9b6c544b010b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.263104 Feb 17 04:38:29.775098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 295/575] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:29 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:29.832987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:29.833684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:29.842017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.842525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.843398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.843897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.973348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:29.983219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-04225c68-5bf6-4116-8e92-f6cca563d9c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1214 microversion: 2.1 time: 0.154326 Feb 17 04:38:29.983877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 281/576] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:29 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:30.665040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:30.673266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:30.680984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.681745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.682813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.683684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.793380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:30.794677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:30.804003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.806618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.806618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.806618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.033297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.042981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-30a8d5af-2f3e-4221-812d-b95cf9f21a73 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.255018 Feb 17 04:38:31.050250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 282/577] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:30 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:31.050495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.050627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:31.050627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:31.057212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.057813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.058132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.058566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.059060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.060030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.061374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-958cceb9-8926-4f45-b226-e004795134af tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.401085 Feb 17 04:38:31.062324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 296/578] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:30 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:31.182892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.193253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3ff51975-e216-45fe-bcdc-f9b34921d456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1276 microversion: 2.1 time: 0.148384 Feb 17 04:38:31.193853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 283/579] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:31 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:31.656913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-a4b30815-8bd2-42fa-bceb-a310bce326f7 req-a4a3ef47-2059-48f3-8980-c265a98f1c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "name": "network-vif-unplugged", "status": "completed", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:31.661354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:31.661354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:31.682046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a4b30815-8bd2-42fa-bceb-a310bce326f7 req-a4a3ef47-2059-48f3-8980-c265a98f1c7f service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.683108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a4b30815-8bd2-42fa-bceb-a310bce326f7 req-a4a3ef47-2059-48f3-8980-c265a98f1c7f service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.724610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-a4b30815-8bd2-42fa-bceb-a310bce326f7 req-a4a3ef47-2059-48f3-8980-c265a98f1c7f service nova] Creating event network-vif-unplugged:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:38:31.736728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-a4b30815-8bd2-42fa-bceb-a310bce326f7 req-a4a3ef47-2059-48f3-8980-c265a98f1c7f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087987 Feb 17 04:38:31.738632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 297/580] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:32.062760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:32.063592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:32.072258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.072783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.073709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.074204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.084201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:32.085125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:32.094677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.095451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.096299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.096764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.313059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:32.323025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1b5c9785-d966-44f2-9a6f-34093f41c793 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.264672 Feb 17 04:38:32.323669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 284/581] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:32 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:32.328956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:32.329634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:32.338091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.338603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.339514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.340137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.560083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:32.570613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b36db64f-b1cb-4674-8877-a07b0fecebef tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.245632 Feb 17 04:38:32.571238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 285/582] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:32 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:32.700028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:32.709950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:32.711780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:32.713086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-786b8396-ff14-4a2b-95f5-f1d0c4863d60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1723 microversion: 2.20 time: 0.634145 Feb 17 04:38:32.713772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 298/583] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:32 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1723 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:38:33.346900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:33.348028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:33.360636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.361383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.362603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.363250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.589321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:33.589958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:33.598059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.598864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.599581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.599909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.869289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:33.878671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7fb8df8e-976d-479a-aecb-e6836c9eddef tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.538322 Feb 17 04:38:33.879550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 286/584] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:33 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:33.884494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:33.885104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:33.893248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.893757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.894615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.895713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.039566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:34.052965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:34.055059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:34.056355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-eee9c9cb-9602-404c-a0b6-2a79c74491ad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1655 microversion: 2.20 time: 0.176047 Feb 17 04:38:34.056964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 287/585] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:33 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:34.313324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:34.323523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-35fa1037-cfb6-4bd7-b576-65cf35a9dd7a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.737880 Feb 17 04:38:34.324945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 299/586] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:33 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:34.768962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-8268efe3-af73-4001-80ff-c73519c7ec29 req-5eafef9e-e65f-495e-a21a-678451bf1b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a076d3cd-b9c1-4802-bdae-3941d4348e7c", "name": "network-vif-deleted", "tag": "72ce24c8-c620-47e9-bb1f-d76da6e573dc"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:34.772633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:34.772633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:34.784617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8268efe3-af73-4001-80ff-c73519c7ec29 req-5eafef9e-e65f-495e-a21a-678451bf1b6c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.785263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8268efe3-af73-4001-80ff-c73519c7ec29 req-5eafef9e-e65f-495e-a21a-678451bf1b6c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.806733 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-8268efe3-af73-4001-80ff-c73519c7ec29 req-5eafef9e-e65f-495e-a21a-678451bf1b6c service nova] Creating event network-vif-deleted:72ce24c8-c620-47e9-bb1f-d76da6e573dc for instance a076d3cd-b9c1-4802-bdae-3941d4348e7c on hv-cinder-75995 Feb 17 04:38:34.812714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-8268efe3-af73-4001-80ff-c73519c7ec29 req-5eafef9e-e65f-495e-a21a-678451bf1b6c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055290 Feb 17 04:38:34.813399 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 288/587] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:34.898825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:34.899621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:34.912325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.913413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.915665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.917440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.083316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:35.089333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:35.119475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.120873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.122722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.123864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.256291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.257015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.258169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lazy-loading 'fault' on Instance uuid a076d3cd-b9c1-4802-bdae-3941d4348e7c {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:35.356532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.367490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.371098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.373048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c58abe0f-f63d-4e92-9aa4-9b1a86d8bec6 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 200 len: 1370 microversion: 2.20 time: 0.299411 Feb 17 04:38:35.374352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 289/588] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:35 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:35.383645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:35.384641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:35.396299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.397581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.399960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.400463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.471813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.481651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9832ea3a-3522-4f38-9454-e05cdb3d83a1 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.587585 Feb 17 04:38:35.482621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 300/589] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:34 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:35.736209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.753054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-596ba6f2-36e9-4a0f-88b1-c726ec9fd862 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.374221 Feb 17 04:38:35.759044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 290/590] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:35 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:36.401318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:36.402823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:36.411857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.412768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.414662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.415449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.473035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] HTTP exception thrown: Instance a076d3cd-b9c1-4802-bdae-3941d4348e7c could not be found. Feb 17 04:38:36.473359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Returning 404 to user: Instance a076d3cd-b9c1-4802-bdae-3941d4348e7c could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:36.474278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-34518974-3d5f-4dec-8c82-2e4e018fab9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 404 len: 111 microversion: 2.20 time: 0.077146 Feb 17 04:38:36.474905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 301/591] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:36 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:38:36.485396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-729299c5-05ba-40a8-8c51-f68225230c97 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '.version_select at 0x7f9b2ff211e0>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:36.502207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:36.502815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:36.521923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.522439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.523423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.523923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.555123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-729299c5-05ba-40a8-8c51-f68225230c97 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327573917" status: 204 len: 0 microversion: 2.20 time: 0.074606 Feb 17 04:38:36.557314 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 291/592] 10.222.0.73 () {60 vars in 1249 bytes} [Wed Feb 17 04:38:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327573917 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 17 04:38:36.625667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-5b42d069-b3cc-4054-8392-f94148697e1b req-dcda666c-0d0c-4da0-ad16-24ee5cdbb330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "name": "network-vif-plugged", "status": "completed", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:36.627556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:36.627556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:36.653493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-5b42d069-b3cc-4054-8392-f94148697e1b req-dcda666c-0d0c-4da0-ad16-24ee5cdbb330 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.654169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-5b42d069-b3cc-4054-8392-f94148697e1b req-dcda666c-0d0c-4da0-ad16-24ee5cdbb330 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.678597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-5b42d069-b3cc-4054-8392-f94148697e1b req-dcda666c-0d0c-4da0-ad16-24ee5cdbb330 service nova] Creating event network-vif-plugged:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:38:36.684432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-5b42d069-b3cc-4054-8392-f94148697e1b req-dcda666c-0d0c-4da0-ad16-24ee5cdbb330 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062833 Feb 17 04:38:36.685525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 292/593] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:38:36.778176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:36.779077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:36.804417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.805140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.807075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.809506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:37.083699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:37.095836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4cc7b974-3123-4fdc-9225-e5799bfa6c3b tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.598021 Feb 17 04:38:37.096821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 302/594] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:36 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:37.103397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-af2e8ad5-7053-4006-811b-fba8c8f41dd8 req-f04e1a73-b323-47c2-a717-9dfef9855298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c8d1b1-cbc5-437c-8e77-b69838822e7b", "tag": "40c6a7ff-cac8-485d-9c88-0e660a3d4fed"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:37.105997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:37.105997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:37.118588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-af2e8ad5-7053-4006-811b-fba8c8f41dd8 req-f04e1a73-b323-47c2-a717-9dfef9855298 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:37.119350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-af2e8ad5-7053-4006-811b-fba8c8f41dd8 req-f04e1a73-b323-47c2-a717-9dfef9855298 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:37.146967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-af2e8ad5-7053-4006-811b-fba8c8f41dd8 req-f04e1a73-b323-47c2-a717-9dfef9855298 service nova] Creating event network-changed:40c6a7ff-cac8-485d-9c88-0e660a3d4fed for instance 36c8d1b1-cbc5-437c-8e77-b69838822e7b on hv-cinder-75995 Feb 17 04:38:37.153289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-af2e8ad5-7053-4006-811b-fba8c8f41dd8 req-f04e1a73-b323-47c2-a717-9dfef9855298 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054801 Feb 17 04:38:37.153940 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 303/595] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:37.168317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:37.180734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f8a86450-8619-4e41-b93c-bf675ccd98c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.407913 Feb 17 04:38:37.191538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 293/596] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:36 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:38.120133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:38.121554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:38.130092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.130930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.131819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.132879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.201686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:38.202607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:38.211814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.212332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.213202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.213705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.374890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.385629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3a1544b0-aa1f-4962-960a-a399c7e73617 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1262 microversion: 2.1 time: 0.270610 Feb 17 04:38:38.386518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 304/597] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:38 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1262 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:38.393972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4a3c3625-415f-4e96-9845-136e926e9f50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'create', calling method: .version_select at 0x7f9b2feb20d0>, body: {"keypair": {"name": "tempest-keypair-1447289100"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:38.425526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-4a3c3625-415f-4e96-9845-136e926e9f50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:38.430146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-4a3c3625-415f-4e96-9845-136e926e9f50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for user cd048d5803b14ad2b23a35d8f288002c and project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:38.465109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.474415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fdc4c977-bdbf-42f0-a2e3-0482e49e177d tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.277995 Feb 17 04:38:38.475034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 294/598] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:38 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:38.775205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-4a3c3625-415f-4e96-9845-136e926e9f50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:38.779541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-4a3c3625-415f-4e96-9845-136e926e9f50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for user cd048d5803b14ad2b23a35d8f288002c and project b4db349eea3a41deb61c89e67a673600. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:38.793760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4a3c3625-415f-4e96-9845-136e926e9f50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.405322 Feb 17 04:38:38.794421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 305/599] 10.222.0.73 () {62 vars in 1189 bytes} [Wed Feb 17 04:38:38 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 407 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:38:39.404588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:39.405259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.414142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.414661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.415542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.416036 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.493444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:39.494443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.514937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.515542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.516550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.517169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.737225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:39.746558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-87035cfd-95b2-41e6-a5e9-6b3e038ce865 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1446 microversion: 2.1 time: 0.346011 Feb 17 04:38:39.747355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 295/600] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:39 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1446 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:39.765400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:39.774760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0183932e-e3ea-4b82-8bfb-5393086343e7 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.286081 Feb 17 04:38:39.775000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:39.775475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 306/601] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:39 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:39.775707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.788111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.790184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.791845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.792958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:40.092993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:40.102225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ac6b1811-54c1-476b-b166-46e3f2327a68 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1446 microversion: 2.1 time: 0.332448 Feb 17 04:38:40.103019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 296/602] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:39 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1446 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:40.119994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9ccaa9d1-590e-431f-aee5-826c1d043d8f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'create', calling method: .version_select at 0x7f9b2feb27b8>, body: {"pool": null} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:40.377916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-56efd642-20c4-4ee8-8cb8-af8637c6808f req-81f6d980-8da0-4462-81fd-a8c2e46f3cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c8d1b1-cbc5-437c-8e77-b69838822e7b", "name": "network-vif-plugged", "status": "completed", "tag": "40c6a7ff-cac8-485d-9c88-0e660a3d4fed"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:40.379726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:40.379726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:40.389336 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-56efd642-20c4-4ee8-8cb8-af8637c6808f req-81f6d980-8da0-4462-81fd-a8c2e46f3cb8 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:40.389787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-56efd642-20c4-4ee8-8cb8-af8637c6808f req-81f6d980-8da0-4462-81fd-a8c2e46f3cb8 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:40.407379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-56efd642-20c4-4ee8-8cb8-af8637c6808f req-81f6d980-8da0-4462-81fd-a8c2e46f3cb8 service nova] Creating event network-vif-plugged:40c6a7ff-cac8-485d-9c88-0e660a3d4fed for instance 36c8d1b1-cbc5-437c-8e77-b69838822e7b on hv-cinder-75995 Feb 17 04:38:40.413038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-56efd642-20c4-4ee8-8cb8-af8637c6808f req-81f6d980-8da0-4462-81fd-a8c2e46f3cb8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039629 Feb 17 04:38:40.414202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 297/603] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:38:40.797641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:40.798540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:40.807990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:40.808667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:40.809621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:40.810193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.317856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:41.327359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ce31a772-4bc3-436a-8294-585a0fe2a625 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1318 microversion: 2.1 time: 0.534522 Feb 17 04:38:41.328269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 298/604] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:40 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:42.289707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1721636671", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1045c1fd-b2e6-4a47-b34a-2f03f2ccfda3"}], "security_groups": [{"name": "tempest-securitygroup--126447507"}], "key_name": "tempest-keypair-1447289100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:42.475221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] validate_networks() for [('1045c1fd-b2e6-4a47-b34a-2f03f2ccfda3', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:42.709613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9ccaa9d1-590e-431f-aee5-826c1d043d8f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.593472 Feb 17 04:38:42.712015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 307/605] 10.222.0.73 () {60 vars in 1160 bytes} [Wed Feb 17 04:38:40 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:42.717332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:42.717991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:42.727942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.728462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.729319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.729820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.165211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:43.165690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:43.166289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:43.167188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:43.167767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:43.176111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:43.178035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.178556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.179550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.180086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.185201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2ee77697-88a3-410f-91c7-0c634e40ba30 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1508 microversion: 2.1 time: 0.471891 Feb 17 04:38:43.186021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 308/606] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:42 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:43.190694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'action', calling method: .version_select at 0x7f9b3dea5ae8>, body: {"addFloatingIp": {"address": "172.27.2.212"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:43.192042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.201292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.201808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.201983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for project b4db349eea3a41deb61c89e67a673600. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:43.202663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.203163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.206842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Getting quotas for user cd048d5803b14ad2b23a35d8f288002c and project b4db349eea3a41deb61c89e67a673600. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:43.220806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:43.222984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:43.277286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Acquired lock "refresh_cache-d78384a9-70f3-4b71-afd3-75be242a9c9e" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:38:43.335599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-97322976-7089-4555-9540-4fb35365bf9c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.051403 Feb 17 04:38:43.336317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 299/607] 10.222.0.73 () {62 vars in 1178 bytes} [Wed Feb 17 04:38:42 2021] POST /compute/v2.1/servers => generated 401 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 04:38:43.341692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fbd3bb4-58c6-4642-8bd2-a397d7a1ccb2"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:43.343058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.352078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.352524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.353428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.353879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.551049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] HTTP exception thrown: Invalid volume: volume 2fbd3bb4-58c6-4642-8bd2-a397d7a1ccb2 is already attached to instances: d0da21aa-1ab0-4752-b15a-194a6de5adf8 Feb 17 04:38:43.552023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Returning 400 to user: Invalid volume: volume 2fbd3bb4-58c6-4642-8bd2-a397d7a1ccb2 is already attached to instances: d0da21aa-1ab0-4752-b15a-194a6de5adf8 {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:43.553390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3cbdfdb6-9918-4117-bac9-0ae87456995a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.215849 Feb 17 04:38:43.554991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 300/608] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:38:43 2021] POST /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b/os-volume_attachments => generated 174 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:38:43.561635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d30f158b-e0b0-42e0-8fa6-b225b2e297a1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:43.562637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d30f158b-e0b0-42e0-8fa6-b225b2e297a1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.676040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d30f158b-e0b0-42e0-8fa6-b225b2e297a1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:43.686007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d30f158b-e0b0-42e0-8fa6-b225b2e297a1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:43.687655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d30f158b-e0b0-42e0-8fa6-b225b2e297a1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:43.689624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d30f158b-e0b0-42e0-8fa6-b225b2e297a1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1282 microversion: 2.20 time: 0.133172 Feb 17 04:38:43.690238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 301/609] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:43 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:43.701867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:43.701867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.710135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.710713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.711538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.712041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.931749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lazy-loading 'services' on Instance uuid d0da21aa-1ab0-4752-b15a-194a6de5adf8 {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:44.233926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3dec27ea-a080-4e84-bafa-86ca5e6ff0fe tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8/os-volume_attachments/2fbd3bb4-58c6-4642-8bd2-a397d7a1ccb2" status: 202 len: 0 microversion: 2.1 time: 0.542093 Feb 17 04:38:44.234767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 302/610] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:38:43 2021] DELETE /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8/os-volume_attachments/2fbd3bb4-58c6-4642-8bd2-a397d7a1ccb2 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:44.711300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:44.712088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:44.721262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.721727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.722594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.723090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.857567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.870113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.872417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.873881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8e90613e-777a-4d4a-b699-c588aa2bb815 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1334 microversion: 2.20 time: 0.167874 Feb 17 04:38:44.874710 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 303/611] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:44 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:38:45.641631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-972001063", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "373accc4-7a29-4586-831f-494c09eed7f5"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:45.723746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] validate_networks() for [('373accc4-7a29-4586-831f-494c09eed7f5', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:45.854888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Building network info cache for instance {{(pid=98221) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:38:46.528573 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:46.529400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:46.530199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:46.530662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:46.531139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:46.542437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.542946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.544125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.544629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.564161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:46.568728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for user dc1261a734684bc6bfde7bb9395be18c and project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:46.581095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:46.583825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:46.667183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3de140b7-a677-4667-b55e-0ac98c39d306 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030258 Feb 17 04:38:46.673912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 304/612] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:46.675116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:46.676101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:46.686030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.686912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.687998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.688633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.771942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:38:47.170586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e6e188f5-1ff5-4cab-aa2a-314c86673d5f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 204 len: 0 microversion: 2.1 time: 0.499889 Feb 17 04:38:47.171422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 305/613] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:38:46 2021] DELETE /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:38:47.177257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-2d92c428-41d0-459f-96eb-b39f63ac701f req-bd4f1cc1-ff69-45be-b03f-472ff0f3430d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:47.179768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:47.179768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:47.189759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-2d92c428-41d0-459f-96eb-b39f63ac701f req-bd4f1cc1-ff69-45be-b03f-472ff0f3430d service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.190234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-2d92c428-41d0-459f-96eb-b39f63ac701f req-bd4f1cc1-ff69-45be-b03f-472ff0f3430d service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.210506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-2d92c428-41d0-459f-96eb-b39f63ac701f req-bd4f1cc1-ff69-45be-b03f-472ff0f3430d service nova] Creating event network-changed:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:38:47.215929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-2d92c428-41d0-459f-96eb-b39f63ac701f req-bd4f1cc1-ff69-45be-b03f-472ff0f3430d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043066 Feb 17 04:38:47.216741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 306/614] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:47.222167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:47.222946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:47.235155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.235767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.236664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.237149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.370699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:47.382969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:47.385175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:47.386860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ff1ba71b-a7dd-4aa8-914f-0e53032c931e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1340 microversion: 2.20 time: 0.168826 Feb 17 04:38:47.387687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 307/615] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:47 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1340 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:47.394138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1f628b01-4ce8-4f97-b9c7-2d355df817eb tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:47.395075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1f628b01-4ce8-4f97-b9c7-2d355df817eb tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:47.527016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1f628b01-4ce8-4f97-b9c7-2d355df817eb tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:47.543085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1f628b01-4ce8-4f97-b9c7-2d355df817eb tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1217 microversion: 2.1 time: 0.153668 Feb 17 04:38:47.544528 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 308/616] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:47 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:47.549825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:47.551843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:47.561484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.562064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.562944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.563545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.798458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Updating instance_info_cache with network_info: [{"id": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0", "address": "fa:16:3e:d2:19:f5", "network": {"id": "1e85d977-59c3-4c3c-9bba-18bb58ffd3cd", "bridge": "br-int", "label": "tempest-TestShelveInstance-330157398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d447f221703e4725a470bab1096716e0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapcd4c018b-0a", "ovs_interfaceid": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98221) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:38:47.838890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:47.850057 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-63ef4f38-fb2e-40f9-8a29-331ce26599e8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1673 microversion: 2.1 time: 0.304312 Feb 17 04:38:47.851695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 309/617] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:47 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:47.860671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Releasing lock "refresh_cache-d78384a9-70f3-4b71-afd3-75be242a9c9e" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:38:47.861653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1e786bc2-e56d-44fa-92ca-96613d7963a7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e/action" status: 202 len: 0 microversion: 2.1 time: 4.674812 Feb 17 04:38:47.864034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 309/618] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:43 2021] POST /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e/action => generated 0 bytes in 4678 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:38:48.406408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:48.407094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:48.415722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.416240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.417104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.417598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.562519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:48.563207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:48.572674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.573537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.574593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.575293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.692739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:48.709068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:48.711387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:48.712519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7e133515-be8c-4270-a427-07603a987e7f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.310297 Feb 17 04:38:48.719415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 310/619] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:48 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:48.741798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:48.772977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-032bff71-10d8-4643-a155-d343b6d40269 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1277 microversion: 2.1 time: 0.213702 Feb 17 04:38:48.773699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 310/620] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:48 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:48.871458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:48.882970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:48.882970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.882970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.882970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.883592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.294680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:49.304580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1499d1b3-eb70-40b0-8f24-3efb75619ab9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1673 microversion: 2.1 time: 0.437490 Feb 17 04:38:49.309144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 311/621] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:48 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1673 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:49.738776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:49.739467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.748838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.749723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.750780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.751623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.798565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:49.799921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.810168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.810911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.811947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.812568 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.978768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:49.997044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-85fb37d3-6c3c-4b4c-93ba-b1fcaf94e0e6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1275 microversion: 2.1 time: 0.209529 Feb 17 04:38:49.998522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 312/622] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:49 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:50.006165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-ba76ed45-443f-4021-ab6a-d8b4574d0e6e req-a6bb2e0d-e33d-4fc6-a980-9fb94d6c63a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe67c43f-82ea-4944-a563-9fed39d42080", "name": "network-vif-unplugged", "status": "completed", "tag": "7c039b81-545d-4b96-8225-5c9d5bbd4f40"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:50.008436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:50.008436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:50.020645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-ba76ed45-443f-4021-ab6a-d8b4574d0e6e req-a6bb2e0d-e33d-4fc6-a980-9fb94d6c63a0 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.021152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-ba76ed45-443f-4021-ab6a-d8b4574d0e6e req-a6bb2e0d-e33d-4fc6-a980-9fb94d6c63a0 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.040683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-ba76ed45-443f-4021-ab6a-d8b4574d0e6e req-a6bb2e0d-e33d-4fc6-a980-9fb94d6c63a0 service nova] Creating event network-vif-unplugged:7c039b81-545d-4b96-8225-5c9d5bbd4f40 for instance fe67c43f-82ea-4944-a563-9fed39d42080 on hv-cinder-75995 Feb 17 04:38:50.045922 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-ba76ed45-443f-4021-ab6a-d8b4574d0e6e req-a6bb2e0d-e33d-4fc6-a980-9fb94d6c63a0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044959 Feb 17 04:38:50.047163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 313/623] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:50.326907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:50.327975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:50.338406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.339081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.340225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.341252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.723161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:50.732533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c5fc9cc8-afff-41eb-8a40-997f43ace60d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1673 microversion: 2.1 time: 0.413547 Feb 17 04:38:50.733517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 314/624] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:50 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1673 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:50.784135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:50.794622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:50.796354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:50.797763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-47db3497-af22-4834-b692-5f854d72fa12 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 1.063371 Feb 17 04:38:50.798762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 311/625] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:49 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:51.016674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:51.017711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.026447 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.026971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.027975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.028547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.536673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:51.547053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-02eca1e3-1dfe-4140-b842-dd96a47c8547 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1317 microversion: 2.1 time: 0.534447 Feb 17 04:38:51.552695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 315/626] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:51 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:51.750725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:51.751849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.760641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.761506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.762572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.763310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.818715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:51.819856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.833148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.836646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.837596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.842859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.025046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.035425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f4ef8b35-9918-4f22-aef5-6015ade22f3e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1606 microversion: 2.1 time: 0.288974 Feb 17 04:38:52.035988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 312/627] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:51 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1606 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:52.048306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d96463e9-4ce0-41c9-96f2-a226fb8fa01c req-8863ecb1-2e2f-4d15-b89c-8cb27c7ba505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:52.050459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:52.050459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:52.060228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d96463e9-4ce0-41c9-96f2-a226fb8fa01c req-8863ecb1-2e2f-4d15-b89c-8cb27c7ba505 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.060736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d96463e9-4ce0-41c9-96f2-a226fb8fa01c req-8863ecb1-2e2f-4d15-b89c-8cb27c7ba505 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.083992 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d96463e9-4ce0-41c9-96f2-a226fb8fa01c req-8863ecb1-2e2f-4d15-b89c-8cb27c7ba505 service nova] Creating event network-changed:9f18046e-e3e6-4296-a693-3a238c8173b1 for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 on hv-cinder-75995 Feb 17 04:38:52.104763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d96463e9-4ce0-41c9-96f2-a226fb8fa01c req-8863ecb1-2e2f-4d15-b89c-8cb27c7ba505 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060243 Feb 17 04:38:52.105394 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 313/628] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:52.300584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.313269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.316795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.316795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c5ff3953-a3f2-4d91-bd2c-0ba1cbc51189 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.501667 Feb 17 04:38:52.319479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 316/629] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:51 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:52.567673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:52.568561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:52.578910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b5d62a88-a23a-4664-aca5-b89dd280a0a3 req-e559439f-a162-44aa-9bbd-db13eba7f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebeed2ab-885b-4680-a4f0-19c53a6afd8b", "tag": "cdc7a4d3-07bb-42ba-b6af-ec8e047f2096"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:52.586219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:52.586219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:52.586490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.586490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.586490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.587051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.603743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b5d62a88-a23a-4664-aca5-b89dd280a0a3 req-e559439f-a162-44aa-9bbd-db13eba7f6eb service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.604475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b5d62a88-a23a-4664-aca5-b89dd280a0a3 req-e559439f-a162-44aa-9bbd-db13eba7f6eb service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.661441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b5d62a88-a23a-4664-aca5-b89dd280a0a3 req-e559439f-a162-44aa-9bbd-db13eba7f6eb service nova] Creating event network-changed:cdc7a4d3-07bb-42ba-b6af-ec8e047f2096 for instance ebeed2ab-885b-4680-a4f0-19c53a6afd8b on hv-cinder-75995 Feb 17 04:38:52.669711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b5d62a88-a23a-4664-aca5-b89dd280a0a3 req-e559439f-a162-44aa-9bbd-db13eba7f6eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095012 Feb 17 04:38:52.671995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 317/630] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:53.057175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:53.058692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:53.070727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.071312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.072252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.072758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.094641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.105279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d884e153-747d-45cf-b736-c2f4f3bfd75e tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1317 microversion: 2.1 time: 0.542899 Feb 17 04:38:53.105946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 314/631] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:52 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:53.256427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.274675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a686b7ca-f2b0-4109-8b7a-670f49b44429 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 200 len: 1606 microversion: 2.1 time: 0.222490 Feb 17 04:38:53.275652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 318/632] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:53 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 1606 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:53.339343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:53.340038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:53.349625 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.351054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.352150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.352872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.668790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.690568 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.692228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.693367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-75314f9e-51ab-427e-a560-3edd6ba49c05 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.358736 Feb 17 04:38:53.694501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 315/633] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:53 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:54.127993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.130249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:54.148510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.150602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.152795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.154118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.293471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d9adda56-4b93-4f8c-a9e2-68a9933254e1 req-04c7c613-4cc1-42cb-b1ed-f2bd5ebc5e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe67c43f-82ea-4944-a563-9fed39d42080", "name": "network-vif-deleted", "tag": "7c039b81-545d-4b96-8225-5c9d5bbd4f40"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:54.295976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:54.295976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:54.308875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d9adda56-4b93-4f8c-a9e2-68a9933254e1 req-04c7c613-4cc1-42cb-b1ed-f2bd5ebc5e2e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.309554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d9adda56-4b93-4f8c-a9e2-68a9933254e1 req-04c7c613-4cc1-42cb-b1ed-f2bd5ebc5e2e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.329006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d9adda56-4b93-4f8c-a9e2-68a9933254e1 req-04c7c613-4cc1-42cb-b1ed-f2bd5ebc5e2e service nova] Creating event network-vif-deleted:7c039b81-545d-4b96-8225-5c9d5bbd4f40 for instance fe67c43f-82ea-4944-a563-9fed39d42080 on hv-cinder-75995 Feb 17 04:38:54.334635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d9adda56-4b93-4f8c-a9e2-68a9933254e1 req-04c7c613-4cc1-42cb-b1ed-f2bd5ebc5e2e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053133 Feb 17 04:38:54.335411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 316/634] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:54.341094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.342221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:54.352306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.352848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.353766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.354271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.416734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] HTTP exception thrown: Instance fe67c43f-82ea-4944-a563-9fed39d42080 could not be found. Feb 17 04:38:54.416959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Returning 404 to user: Instance fe67c43f-82ea-4944-a563-9fed39d42080 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:54.417791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-99de140e-95ec-4bd1-88c0-c39a055a72c0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 404 len: 111 microversion: 2.1 time: 0.081085 Feb 17 04:38:54.418425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 317/635] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:54 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:38:54.428945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-72c08923-93bb-416f-8ba8-e5ebe9835088 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '.version_select at 0x7f9b2ff3c9d8>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.474521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-72c08923-93bb-416f-8ba8-e5ebe9835088 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132356022" status: 202 len: 0 microversion: 2.1 time: 0.050684 Feb 17 04:38:54.477106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 318/636] 10.222.0.73 () {58 vars in 1208 bytes} [Wed Feb 17 04:38:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132356022 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:54.713369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.714124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:54.733811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.734429 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.735547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.735969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.851904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:54.866461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d7d45286-0852-4215-a00b-025d72ef4b31 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1317 microversion: 2.1 time: 0.746778 Feb 17 04:38:54.867075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 319/637] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:54 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:55.064450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:55.077180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:55.079031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:55.079936 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-82e63e2c-a49d-4321-b92b-66a8e3a57bc1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.371111 Feb 17 04:38:55.083479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 319/638] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:54 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:55.885234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:55.885875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:55.894033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.894536 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.895400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.895892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.102495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:56.103171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:56.111882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.112961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.113825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.114328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.125920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.135015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0fd817e5-a86d-4f8e-bd6e-c6ce3ec8ba41 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1317 microversion: 2.1 time: 0.253881 Feb 17 04:38:56.135961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 320/639] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:55 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:56.140515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c8610b17-a6ba-497c-9159-6f36910cb4a2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: .version_select at 0x7f9b2ff21598>, body: {"keypair": {"name": "tempest-keypair-1194524392"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:56.164890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-c8610b17-a6ba-497c-9159-6f36910cb4a2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:56.169070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-c8610b17-a6ba-497c-9159-6f36910cb4a2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for user b46934d3d2dd4c129cc4359c322854e1 and project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:56.336441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.345910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.347564 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.348700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b6f9b5b3-61b7-4570-8d2f-40a8a431f7ea tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.250973 Feb 17 04:38:56.349453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 320/640] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:56 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:38:56.452368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-c8610b17-a6ba-497c-9159-6f36910cb4a2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:56.457212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-c8610b17-a6ba-497c-9159-6f36910cb4a2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for user b46934d3d2dd4c129cc4359c322854e1 and project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'key_pairs'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:56.471465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c8610b17-a6ba-497c-9159-6f36910cb4a2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.334547 Feb 17 04:38:56.472126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 321/641] 10.222.0.73 () {60 vars in 1148 bytes} [Wed Feb 17 04:38:56 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:57.060296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1052747798"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:57.060925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:57.069706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.070208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.071053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.071701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.154066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:57.155096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:57.163938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.164616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.165491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.165996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.351214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.network.security_group_api [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Removing security group c44920cf-8ce7-4304-aeb4-587c058b73cb from port e61721f8-ed25-4ebf-82cf-247999d61026 Feb 17 04:38:57.436486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:57.448802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1764b9ee-bd0b-4828-be9f-2d9638b0bcbf tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1317 microversion: 2.1 time: 0.298816 Feb 17 04:38:57.449769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 322/642] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:57 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:57.457791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-06d96096-632b-44f4-8717-f018ce6af60d req-42dcbb22-5824-4a0b-a5c1-100bcfc9dd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebeed2ab-885b-4680-a4f0-19c53a6afd8b", "name": "network-vif-plugged", "status": "completed", "tag": "cdc7a4d3-07bb-42ba-b6af-ec8e047f2096"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:57.464087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:57.464087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:57.473307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-06d96096-632b-44f4-8717-f018ce6af60d req-42dcbb22-5824-4a0b-a5c1-100bcfc9dd49 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.474025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-06d96096-632b-44f4-8717-f018ce6af60d req-42dcbb22-5824-4a0b-a5c1-100bcfc9dd49 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.493501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-06d96096-632b-44f4-8717-f018ce6af60d req-42dcbb22-5824-4a0b-a5c1-100bcfc9dd49 service nova] Creating event network-vif-plugged:cdc7a4d3-07bb-42ba-b6af-ec8e047f2096 for instance ebeed2ab-885b-4680-a4f0-19c53a6afd8b on hv-cinder-75995 Feb 17 04:38:57.499176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-06d96096-632b-44f4-8717-f018ce6af60d req-42dcbb22-5824-4a0b-a5c1-100bcfc9dd49 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045086 Feb 17 04:38:57.499905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 323/643] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:57.505511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:57.506578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:57.526955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.527756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.529706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.530676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.930928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:57.942620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:57.952559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:57.953784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e9ccd569-0b80-43e9-a28b-6363d7fdfa34 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.452522 Feb 17 04:38:57.954668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 324/644] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:57 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:58.349032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8bae8383-732f-466c-9ea5-e63ff959bd57 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action" status: 202 len: 0 microversion: 2.1 time: 1.291614 Feb 17 04:38:58.350719 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 321/645] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:57 2021] POST /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/action => generated 0 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:58.354222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-a62cc1d4-b0bf-46cd-ba3b-2308dc3a3481 req-4bfc0453-3c98-47f0-9f34-faf26fa80983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:58.355774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:58.355774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:58.360480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-265fc0ae-c50b-4c3f-ba1f-18fbb42d8116 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '.version_select at 0x7f9b2feb2f28>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:58.368372 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a62cc1d4-b0bf-46cd-ba3b-2308dc3a3481 req-4bfc0453-3c98-47f0-9f34-faf26fa80983 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.369168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a62cc1d4-b0bf-46cd-ba3b-2308dc3a3481 req-4bfc0453-3c98-47f0-9f34-faf26fa80983 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.392812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-a62cc1d4-b0bf-46cd-ba3b-2308dc3a3481 req-4bfc0453-3c98-47f0-9f34-faf26fa80983 service nova] Creating event network-changed:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:38:58.399490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-a62cc1d4-b0bf-46cd-ba3b-2308dc3a3481 req-4bfc0453-3c98-47f0-9f34-faf26fa80983 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048522 Feb 17 04:38:58.401023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 325/646] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:58.469265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:58.470470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:58.481530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.482389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.483621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.484365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.853203 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.862560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ecad9f73-8a23-4d50-a831-66cb11e2cc17 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1317 microversion: 2.1 time: 0.397875 Feb 17 04:38:58.863167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 326/647] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:58 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:58.979178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:58.980075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:58.990084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.991153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.995143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.995143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.032176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-265fc0ae-c50b-4c3f-ba1f-18fbb42d8116 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/c44920cf-8ce7-4304-aeb4-587c058b73cb" status: 202 len: 0 microversion: 2.1 time: 0.676517 Feb 17 04:38:59.036318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 322/648] 10.222.0.73 () {58 vars in 1262 bytes} [Wed Feb 17 04:38:58 2021] DELETE /compute/v2.1/os-security-groups/c44920cf-8ce7-4304-aeb4-587c058b73cb => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:59.042312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '.version_select at 0x7f9b3c95bf28>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:59.440645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:59.452906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:59.455064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:59.456355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3b3ac486-d83f-4d5e-8426-3e2d5bfd2e92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.481591 Feb 17 04:38:59.456968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 327/649] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:58 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:59.565206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-3e3a762a-8d60-47bd-aa84-c73587a9b864 req-ce2e3c63-bb10-4354-bd6b-f297f51f8c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "name": "network-vif-plugged", "status": "completed", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:59.569920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:59.569920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:38:59.580560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3e3a762a-8d60-47bd-aa84-c73587a9b864 req-ce2e3c63-bb10-4354-bd6b-f297f51f8c5c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.581434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3e3a762a-8d60-47bd-aa84-c73587a9b864 req-ce2e3c63-bb10-4354-bd6b-f297f51f8c5c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.604952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-3e3a762a-8d60-47bd-aa84-c73587a9b864 req-ce2e3c63-bb10-4354-bd6b-f297f51f8c5c service nova] Creating event network-vif-plugged:9f18046e-e3e6-4296-a693-3a238c8173b1 for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 on hv-cinder-75995 Feb 17 04:38:59.616001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-3e3a762a-8d60-47bd-aa84-c73587a9b864 req-ce2e3c63-bb10-4354-bd6b-f297f51f8c5c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058528 Feb 17 04:38:59.616001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 328/650] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:59.882216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:59.883073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:59.892740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.894030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.894151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.894626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.183135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:00.196712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.197227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.198103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.198598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.266567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Acquired lock "refresh_cache-f5312116-c2c7-4e67-a046-f48f4eea78fd" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:39:00.301452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.311325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d87e87da-fb17-4b4b-a350-8b76657dbb98 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1506 microversion: 2.1 time: 0.434062 Feb 17 04:39:00.312148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 329/651] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:59 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:00.317790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-626319065", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db318819-52ac-454a-9acd-88522654014f"}], "security_groups": [{"name": "tempest-securitygroup--768209731"}], "key_name": "tempest-keypair-1194524392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:00.514648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] validate_networks() for [('db318819-52ac-454a-9acd-88522654014f', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:39:01.172164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:39:01.172644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:39:01.173356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:39:01.173822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:39:01.174291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:39:01.184108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.184620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.185514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.186027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.205215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:01.209692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Getting quotas for user b46934d3d2dd4c129cc4359c322854e1 and project 0ceefaf95d6747d4874041041d75b0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:01.221252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:39:01.223850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:39:01.306690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e0696963-c953-4f8f-a36a-10e7306dab9a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.993425 Feb 17 04:39:01.313121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 330/652] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:39:00 2021] POST /compute/v2.1/servers => generated 401 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:39:01.380425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:01.381296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:01.390354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.390986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.392052 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.392663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.645909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:01.658374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:01.660275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:01.661548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9e15af90-d3d3-4952-b4e6-f3d857d04a91 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1407 microversion: 2.20 time: 0.353092 Feb 17 04:39:01.663199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 331/653] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:01 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:01.677105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-36b28b9f-cbb3-498f-915c-3410fb3625fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:01.678076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-36b28b9f-cbb3-498f-915c-3410fb3625fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:01.791744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-36b28b9f-cbb3-498f-915c-3410fb3625fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:01.811644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-36b28b9f-cbb3-498f-915c-3410fb3625fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1237 microversion: 2.1 time: 0.142556 Feb 17 04:39:01.812302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 332/654] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:01 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1237 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:02.122491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67a68b1b-72f4-4192-85b5-63ce216ee3bf"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:02.124055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:02.139795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.140812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.142103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.142856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.573925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Building network info cache for instance {{(pid=98221) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:39:02.952878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2d213897-3d61-414a-a885-e0c9766c7ea4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835111 Feb 17 04:39:02.953963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 333/655] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:02 2021] POST /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:02.960043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-968857b7-da61-4fa4-872d-cccb97c2f574 req-1cad85e3-2690-41ce-9a45-b38826cc3cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:02.984957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:02.984957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:02.997513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-968857b7-da61-4fa4-872d-cccb97c2f574 req-1cad85e3-2690-41ce-9a45-b38826cc3cd0 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.998340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-968857b7-da61-4fa4-872d-cccb97c2f574 req-1cad85e3-2690-41ce-9a45-b38826cc3cd0 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.025870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-968857b7-da61-4fa4-872d-cccb97c2f574 req-1cad85e3-2690-41ce-9a45-b38826cc3cd0 service nova] Creating event network-changed:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:39:03.033681 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-968857b7-da61-4fa4-872d-cccb97c2f574 req-1cad85e3-2690-41ce-9a45-b38826cc3cd0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077887 Feb 17 04:39:03.034486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 334/656] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:03.056193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:03.059921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.083267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.084612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.087998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.088703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.621823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:03.631424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Updating instance_info_cache with network_info: [{"id": "e61721f8-ed25-4ebf-82cf-247999d61026", "address": "fa:16:3e:82:6d:e7", "network": {"id": "25653d82-43fa-4aa5-a3be-d27965409dd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1513509793-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "14187639adc74d1bb49ed835b238d04c", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tape61721f8-ed", "ovs_interfaceid": "e61721f8-ed25-4ebf-82cf-247999d61026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98221) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:39:03.634582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:03.635721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:03.637202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e645108d-3fd3-41f4-9580-7a3f22536a98 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1599 microversion: 2.20 time: 0.600653 Feb 17 04:39:03.637794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 335/657] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:03 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1599 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:03.683318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Releasing lock "refresh_cache-f5312116-c2c7-4e67-a046-f48f4eea78fd" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:39:03.685286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-61ecbe64-a239-46f6-aa7c-9ff3dc7d2463 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/be415ef1-4afb-4a2b-8f66-3c0f702cef4d" status: 202 len: 0 microversion: 2.1 time: 4.646825 Feb 17 04:39:03.686131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 323/658] 10.222.0.73 () {58 vars in 1253 bytes} [Wed Feb 17 04:38:59 2021] DELETE /compute/v2.1/os-floating-ips/be415ef1-4afb-4a2b-8f66-3c0f702cef4d => generated 0 bytes in 4649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:39:03.691893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:03.693239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.709771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.710260 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.717956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.718720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.760407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:03.761275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.790255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.795736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.796884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.797570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.988294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.003581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fa25251f-9501-4f14-b941-9152054c52f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1307 microversion: 2.1 time: 0.364241 Feb 17 04:39:04.004831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 336/659] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:03 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:04.010553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:04.011506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:04.019911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1d24cd98-f2fd-45d2-ad39-730c69e32c6f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.332088 Feb 17 04:39:04.020576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 324/660] 10.222.0.73 () {60 vars in 1306 bytes} [Wed Feb 17 04:39:03 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:04.022191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.022872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.024218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.025328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.235262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lazy-loading 'services' on Instance uuid f5312116-c2c7-4e67-a046-f48f4eea78fd {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:04.483854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9c13ca26-e6bb-4aa6-a444-7655771ca6f2 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments/825c8721-32f8-47da-8485-62fc9ec5e2a0" status: 202 len: 0 microversion: 2.1 time: 0.477237 Feb 17 04:39:04.487000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 337/661] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:39:04 2021] DELETE /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments/825c8721-32f8-47da-8485-62fc9ec5e2a0 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:04.493881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:04.495045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:04.507093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.507631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.508745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.509227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.619653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-961f6fb0-9e8a-49ac-a2c2-3ccc68ae581e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130027 Feb 17 04:39:04.630966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 325/662] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:04 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:05.024675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.025525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.035016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.036311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.039122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.040327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.211583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:05.221102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-19d24615-472a-4911-89a2-82a74be011c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1295 microversion: 2.1 time: 0.201885 Feb 17 04:39:05.228261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 338/663] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:05 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1295 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:05.638719 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.645187 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.663981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.664472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.665567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.666225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.740629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-37c7cda2-959e-4859-a0f3-4233b93bcd79 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105720 Feb 17 04:39:05.741299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 326/664] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:05 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:06.240067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:06.240791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:06.249919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.250510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.251613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.252098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.754832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:06.756652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:06.763142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:06.773112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f82c3671-3d65-4e08-a807-7ad5ebd97844 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1362 microversion: 2.1 time: 0.537119 Feb 17 04:39:06.774251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 339/665] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:06 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:06.784901 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.785703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.786748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.787363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:06.787689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.789021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:06.809465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.812032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.813048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.813960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.892835 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9b3ee795-1002-4258-aff1-8ac4284a6519 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117104 Feb 17 04:39:06.893549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 340/666] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:06 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:06.898804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-aa54b777-fb74-4564-b51b-851df82277bb req-62bf7b0c-a0e4-4202-a215-8d2a028e3b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:06.900765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:06.900765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:06.903767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3124b310-af20-46a7-bf5b-804d4896c701 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.153028 Feb 17 04:39:06.904739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 327/667] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:06 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:06.911656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-aa54b777-fb74-4564-b51b-851df82277bb req-62bf7b0c-a0e4-4202-a215-8d2a028e3b37 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.912480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-aa54b777-fb74-4564-b51b-851df82277bb req-62bf7b0c-a0e4-4202-a215-8d2a028e3b37 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.931431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-aa54b777-fb74-4564-b51b-851df82277bb req-62bf7b0c-a0e4-4202-a215-8d2a028e3b37 service nova] Creating event network-changed:9f18046e-e3e6-4296-a693-3a238c8173b1 for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 on hv-cinder-75995 Feb 17 04:39:06.936659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-aa54b777-fb74-4564-b51b-851df82277bb req-62bf7b0c-a0e4-4202-a215-8d2a028e3b37 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041444 Feb 17 04:39:06.937558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 341/668] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:07.269151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-8bb8e6e3-9d88-46f7-98b8-1577094e4cf3 req-a0ea2de3-ba96-40a9-aa40-61abfe87aa26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ae0bfb-e255-47a6-bf27-52b718f80175", "tag": "6249f6fb-e214-4e01-88cf-00d6399056e8"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:07.271759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:07.271759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:07.281800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8bb8e6e3-9d88-46f7-98b8-1577094e4cf3 req-a0ea2de3-ba96-40a9-aa40-61abfe87aa26 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.282924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8bb8e6e3-9d88-46f7-98b8-1577094e4cf3 req-a0ea2de3-ba96-40a9-aa40-61abfe87aa26 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.309086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-8bb8e6e3-9d88-46f7-98b8-1577094e4cf3 req-a0ea2de3-ba96-40a9-aa40-61abfe87aa26 service nova] Creating event network-changed:6249f6fb-e214-4e01-88cf-00d6399056e8 for instance 35ae0bfb-e255-47a6-bf27-52b718f80175 on hv-cinder-75995 Feb 17 04:39:07.314419 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-8bb8e6e3-9d88-46f7-98b8-1577094e4cf3 req-a0ea2de3-ba96-40a9-aa40-61abfe87aa26 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050467 Feb 17 04:39:07.315238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 328/669] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:07.794433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:07.795712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:07.821785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.825041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.826643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.827332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.906000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:07.907778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:07.919149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.920511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.921836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.922739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.011575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4c55cac9-ea1f-4fba-9b42-5f9d0ccdad89 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110762 Feb 17 04:39:08.012517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 329/670] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:07 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:08.018620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:08.019976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:08.029386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.030375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.031486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.032132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.098019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:08.118700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e827a819-d9d4-40af-8cc3-4d0fb7627b8b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1362 microversion: 2.1 time: 0.329834 Feb 17 04:39:08.119689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 342/671] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:07 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:08.188003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0c0cf590-904c-4193-9e7f-0b3c8f6900c7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.173398 Feb 17 04:39:08.191083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 330/672] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:08 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:09.025148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:09.026206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:09.034655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.035170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.036050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.036549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.111769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f08904b3-0861-4410-980f-148cfcda9e38 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091180 Feb 17 04:39:09.112331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 343/673] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:09 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:09.138023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:09.138809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:09.148026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.148531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.149379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.149867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.201444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:09.202854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:09.212204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.212826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.213910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.214466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.335371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-618b90b1-a8db-45d1-b9a6-a7fa1d9d4e49 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.137785 Feb 17 04:39:09.336218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 344/674] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:09 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:09.480136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:09.489039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-46825cf6-e8ea-4bac-9683-795e93817c2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1362 microversion: 2.1 time: 0.355590 Feb 17 04:39:09.489647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 331/675] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:09 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:10.130540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:10.132653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:10.146533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.147046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.147992 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.148503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.223610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-35688bf6-569d-49f8-827d-da80c3867187 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101794 Feb 17 04:39:10.225213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 345/676] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:10 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:10.347324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:10.348490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:10.358282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.359699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.359699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.360199 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.485242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-380d200f-741b-41a9-9e86-869c6a5876d9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.141826 Feb 17 04:39:10.486402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 332/677] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:10 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:10.510446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:10.511481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:10.520856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.522226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.523080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.523620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.763731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:10.773549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dda5a16e-db3b-408c-a0fa-b9deaff8feb1 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1362 microversion: 2.1 time: 0.267449 Feb 17 04:39:10.774164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 346/678] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:10 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:10.978232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67a68b1b-72f4-4192-85b5-63ce216ee3bf"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:10.979912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:10.992874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.993506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.994586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.995166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.064246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-9990d311-6df4-4b19-9b1d-1f5f7278663f req-9d23e423-4883-4085-97f0-6e6fdf9ae4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ae0bfb-e255-47a6-bf27-52b718f80175", "name": "network-vif-plugged", "status": "completed", "tag": "6249f6fb-e214-4e01-88cf-00d6399056e8"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:11.066134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:11.066134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:11.076188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9990d311-6df4-4b19-9b1d-1f5f7278663f req-9d23e423-4883-4085-97f0-6e6fdf9ae4c2 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.076792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9990d311-6df4-4b19-9b1d-1f5f7278663f req-9d23e423-4883-4085-97f0-6e6fdf9ae4c2 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.095879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-9990d311-6df4-4b19-9b1d-1f5f7278663f req-9d23e423-4883-4085-97f0-6e6fdf9ae4c2 service nova] Creating event network-vif-plugged:6249f6fb-e214-4e01-88cf-00d6399056e8 for instance 35ae0bfb-e255-47a6-bf27-52b718f80175 on hv-cinder-75995 Feb 17 04:39:11.101133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-9990d311-6df4-4b19-9b1d-1f5f7278663f req-9d23e423-4883-4085-97f0-6e6fdf9ae4c2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043139 Feb 17 04:39:11.101833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 347/679] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:11.191135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] HTTP exception thrown: Invalid volume: volume 67a68b1b-72f4-4192-85b5-63ce216ee3bf is already attached to instances: ebeed2ab-885b-4680-a4f0-19c53a6afd8b Feb 17 04:39:11.191847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Returning 400 to user: Invalid volume: volume 67a68b1b-72f4-4192-85b5-63ce216ee3bf is already attached to instances: ebeed2ab-885b-4680-a4f0-19c53a6afd8b {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:11.192764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0fa103ab-323c-4c35-92bb-96138d1f889f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.219651 Feb 17 04:39:11.193993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 333/680] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:10 2021] POST /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b/os-volume_attachments => generated 174 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:39:11.238592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:11.240621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.249150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.250078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.250950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.251483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.322092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:11.322947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.326702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-bf5bfe64-5aa6-477b-865d-f4a177c73fd9 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093715 Feb 17 04:39:11.328084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 348/681] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:11 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:11.336869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.337373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.338263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.338824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.498042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:11.498985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.507256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.507804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.510974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.510974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.528773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lazy-loading 'services' on Instance uuid ebeed2ab-885b-4680-a4f0-19c53a6afd8b {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:11.723384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-207c8d02-afe1-4a74-a4b2-6aa56a5a7682 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b/os-volume_attachments/67a68b1b-72f4-4192-85b5-63ce216ee3bf" status: 202 len: 0 microversion: 2.1 time: 0.406957 Feb 17 04:39:11.724046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 334/682] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:39:11 2021] DELETE /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b/os-volume_attachments/67a68b1b-72f4-4192-85b5-63ce216ee3bf => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:11.763667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5ffbf721-6c9b-4681-be1f-a32e596b6d52 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.269231 Feb 17 04:39:11.764312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 349/683] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:11 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:11.794186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:11.795158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.805206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.805715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.807045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.807851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.031659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:12.041529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-05cf259d-1cc5-4641-8e60-6a1cad54f01b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1362 microversion: 2.1 time: 0.252150 Feb 17 04:39:12.042125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 335/684] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:11 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:12.340553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:12.341852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.350629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.351146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.352027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.352528 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.424918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-49ca2ed6-be33-448d-8555-154c9b11e38e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089153 Feb 17 04:39:12.425542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 350/685] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:39:12 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:12.437071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:12.437621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.446177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.446726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.447612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.448113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.620216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] HTTP exception thrown: Instance f5312116-c2c7-4e67-a046-f48f4eea78fd is not attached to volume 825c8721-32f8-47da-8485-62fc9ec5e2a0 Feb 17 04:39:12.620888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Returning 404 to user: Instance f5312116-c2c7-4e67-a046-f48f4eea78fd is not attached to volume 825c8721-32f8-47da-8485-62fc9ec5e2a0 {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:12.621792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b37fda02-8a16-4b1a-a45e-6a785e8095b6 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments/825c8721-32f8-47da-8485-62fc9ec5e2a0" status: 404 len: 154 microversion: 2.1 time: 0.189965 Feb 17 04:39:12.622414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 336/686] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:39:12 2021] DELETE /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd/os-volume_attachments/825c8721-32f8-47da-8485-62fc9ec5e2a0 => generated 154 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:39:12.774510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:12.775592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.784619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.784786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.785557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.786038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.931109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-421a498e-98fa-49ac-9d45-37a0e520d3fc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.160259 Feb 17 04:39:12.932237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 351/687] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:12 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:13.059967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:13.060724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.069350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.069984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.071166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.071715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.294956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:13.304656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8d8418bf-45fd-4559-9d77-af8d18534348 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1548 microversion: 2.1 time: 0.248674 Feb 17 04:39:13.305311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 337/688] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:13 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1548 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:13.323700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:13.324377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.333357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.333911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.337155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.337155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.492996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-14433a0c-1d8a-42e2-9997-c5471c7f82a8 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173807 Feb 17 04:39:13.493661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 352/689] 10.222.0.73 () {58 vars in 1265 bytes} [Wed Feb 17 04:39:13 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:13.942780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:13.943959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.952362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.952883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.953748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.954248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.955368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:13.955931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.964244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.964746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.965597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.966101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.032528 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:39:14.070026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-561d6978-e779-4449-96f7-ea1ae610910e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.131169 Feb 17 04:39:14.070728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 338/690] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:13 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:14.181430 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1974594143", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "373accc4-7a29-4586-831f-494c09eed7f5"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:14.253516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] validate_networks() for [('373accc4-7a29-4586-831f-494c09eed7f5', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:39:14.273404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b13680ec-2c90-4492-a51d-ee3975864551 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 204 len: 0 microversion: 2.1 time: 0.322243 Feb 17 04:39:14.274210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 353/691] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:39:13 2021] DELETE /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:39:14.283499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:14.284356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:14.293542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.294569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.295889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.295889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.857473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:39:14.857974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:39:14.858474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:39:14.858931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:39:14.859436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:39:14.882409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.882926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.883910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.884437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.904061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:14.908536 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Getting quotas for user dc1261a734684bc6bfde7bb9395be18c and project 485e107aac5140888157d73b3f00eca9. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:14.921222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:39:14.924094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:39:15.047013 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-579aee38-7f98-4b90-aaaf-52de6fff2756 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870346 Feb 17 04:39:15.047871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 339/692] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:39:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:39:15.059077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5f772dfb-ee6e-495f-a52d-65fd1b2f9f90 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:15.059771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5f772dfb-ee6e-495f-a52d-65fd1b2f9f90 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.081691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:15.101331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fbbee530-51c0-4859-920c-aed3d49cf5a8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1555 microversion: 2.1 time: 0.822180 Feb 17 04:39:15.102307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 354/693] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:14 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1555 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:15.107542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:15.108598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.118916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.119751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.120351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.120856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.165231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5f772dfb-ee6e-495f-a52d-65fd1b2f9f90 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:15.176425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5f772dfb-ee6e-495f-a52d-65fd1b2f9f90 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1218 microversion: 2.1 time: 0.121350 Feb 17 04:39:15.178021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 340/694] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:15 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:15.238218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f63435e3-3fa0-4980-bdc2-e073ff6e637c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.133869 Feb 17 04:39:15.239179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 355/695] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:15 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:15.634360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:15.635905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.667641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.668273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.669489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.670082 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.713796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-98a35f5d-316b-4223-bed9-77a7789c5f32 req-c34e4fd6-5f80-49eb-b1b7-c98a8d4427b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ae0bfb-e255-47a6-bf27-52b718f80175", "tag": "6249f6fb-e214-4e01-88cf-00d6399056e8"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:15.715632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:15.715632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:15.735821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-98a35f5d-316b-4223-bed9-77a7789c5f32 req-c34e4fd6-5f80-49eb-b1b7-c98a8d4427b8 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.736686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-98a35f5d-316b-4223-bed9-77a7789c5f32 req-c34e4fd6-5f80-49eb-b1b7-c98a8d4427b8 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.758952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-98a35f5d-316b-4223-bed9-77a7789c5f32 req-c34e4fd6-5f80-49eb-b1b7-c98a8d4427b8 service nova] Creating event network-changed:6249f6fb-e214-4e01-88cf-00d6399056e8 for instance 35ae0bfb-e255-47a6-bf27-52b718f80175 on hv-cinder-75995 Feb 17 04:39:15.764453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-98a35f5d-316b-4223-bed9-77a7789c5f32 req-c34e4fd6-5f80-49eb-b1b7-c98a8d4427b8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131756 Feb 17 04:39:15.765129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 356/696] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:15.811033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ea630944-ce1a-4709-810f-55b18cd0005a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.180411 Feb 17 04:39:15.812776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 341/697] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:15 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:16.121642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:16.122563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.131302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.132065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.133233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.133906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.196468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:16.197639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.213474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.220821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.220821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.220821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.395962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.403301 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.407773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a843004f-e60e-41f7-8110-b0bda7668456 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1270 microversion: 2.1 time: 0.217246 Feb 17 04:39:16.409081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 342/698] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:16 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:16.414665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:16.414850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2074ecb5-788d-4279-a1c4-d1b4daadc94e tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1555 microversion: 2.1 time: 0.297483 Feb 17 04:39:16.421028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 357/699] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:16 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:16.422464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.434750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.435261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.436161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.436667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.565446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4acd33b7-16d9-42e7-96e4-e99d6e93cbe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.154670 Feb 17 04:39:16.566283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 343/700] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:16 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:16.827180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:16.829656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.840178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.840808 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.842023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.843366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.995932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0ac7d798-d8cd-4544-9670-a50e8399ef2c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.171526 Feb 17 04:39:17.003574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 358/701] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:16 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:17.433941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:17.436210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:17.437732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.438334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.460144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.460694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.461612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.462777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.463567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.470358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.471691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.472401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.720548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.734242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-17318d19-aa51-4a6f-9e40-fd7a57365882 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1276 microversion: 2.1 time: 0.309918 Feb 17 04:39:17.738747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 344/702] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:17 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:17.744773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:17.746999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.757660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.758571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.760798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.761315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.875582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-893b976b-f73c-4bfd-bd15-1ff94c4a9d6a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 14 microversion: 2.20 time: 0.134640 Feb 17 04:39:17.876305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 345/703] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:17 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:18.013337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:18.014503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.023484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.024495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.024858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.025362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.049411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27797b6e42486d9bdeef931160b837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14187639adc74d1bb49ed835b238d04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:18.072929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3b10da44-e132-4e55-991e-0bc9ef151d3f tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 200 len: 1555 microversion: 2.1 time: 0.643420 Feb 17 04:39:18.073897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 359/704] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:17 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 1555 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:18.180490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-da1bc3e2-a06d-47a3-a370-30f8e3c7a40f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.171088 Feb 17 04:39:18.181800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 346/705] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:18 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:39:18.211667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d47a066d-7b31-4839-8de0-44b225200d4d req-e2d5021f-7f00-47c5-a38b-c01b2546a4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5312116-c2c7-4e67-a046-f48f4eea78fd", "name": "network-vif-deleted", "tag": "e61721f8-ed25-4ebf-82cf-247999d61026"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:18.214261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:18.214261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:18.224949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d47a066d-7b31-4839-8de0-44b225200d4d req-e2d5021f-7f00-47c5-a38b-c01b2546a4c4 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.225390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d47a066d-7b31-4839-8de0-44b225200d4d req-e2d5021f-7f00-47c5-a38b-c01b2546a4c4 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.244790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d47a066d-7b31-4839-8de0-44b225200d4d req-e2d5021f-7f00-47c5-a38b-c01b2546a4c4 service nova] Creating event network-vif-deleted:e61721f8-ed25-4ebf-82cf-247999d61026 for instance f5312116-c2c7-4e67-a046-f48f4eea78fd on hv-cinder-75995 Feb 17 04:39:18.250557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d47a066d-7b31-4839-8de0-44b225200d4d req-e2d5021f-7f00-47c5-a38b-c01b2546a4c4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048035 Feb 17 04:39:18.251333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 360/706] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:18.753731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:18.754498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.763712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.764147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.765000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.765487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.887142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:18.888334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.897680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.898194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.899185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.899700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.036162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-798066c5-5ba8-44a6-9ed7-9e24f58d8da9 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 8583 microversion: 2.20 time: 0.153002 Feb 17 04:39:19.036994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 361/707] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:18 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 8583 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:19.103606 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:19.105315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] [instance: f5312116-c2c7-4e67-a046-f48f4eea78fd] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:19.117489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.118008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.118892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.119857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.178076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] HTTP exception thrown: Instance f5312116-c2c7-4e67-a046-f48f4eea78fd could not be found. Feb 17 04:39:19.178767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Returning 404 to user: Instance f5312116-c2c7-4e67-a046-f48f4eea78fd could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:19.179733 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c176544e-5532-41db-b318-6cfbb853b7e8 tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd" status: 404 len: 111 microversion: 2.1 time: 0.083869 Feb 17 04:39:19.180443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 362/708] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:19 2021] GET /compute/v2.1/servers/f5312116-c2c7-4e67-a046-f48f4eea78fd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:39:19.190784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-14822ba9-65e4-4c16-8aba-8ab3921a75de tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] Calling method '.version_select at 0x7f9b2ff216a8>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:19.240207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-14822ba9-65e4-4c16-8aba-8ab3921a75de tempest-TestMinimumBasicScenario-1806955430 tempest-TestMinimumBasicScenario-1806955430-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2103323820" status: 202 len: 0 microversion: 2.1 time: 0.053373 Feb 17 04:39:19.244273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 363/709] 10.222.0.73 () {58 vars in 1262 bytes} [Wed Feb 17 04:39:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2103323820 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:39:19.246352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:19.247368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:19.256893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.257128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.258008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.258501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.315381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:19.326244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9e310005-31d5-4269-8970-bdd80ad62d51 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.576964 Feb 17 04:39:19.327200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 347/710] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:18 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:19.376382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-79b5d7c3-cc1b-4b6e-8789-02b644f41e20 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.133408 Feb 17 04:39:19.380062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 364/711] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:19 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:20.048799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:20.049859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.059140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.059614 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.060473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.060971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.202169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1ec49355-b046-4485-844c-945e30565b6c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 15025 microversion: 2.20 time: 0.157197 Feb 17 04:39:20.203120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 348/712] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:20 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 15025 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:20.347209 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:20.348044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.358604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.358604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.358604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.359047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.368222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-f5629b2a-aa0d-4978-b407-748be9f16812 req-ced895b2-2ba2-4070-abd2-d7dbbb1e986e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8e2a7c-832b-483c-b67b-c75c347370e6", "tag": "129af318-a8c9-45be-9c96-c02b0ea6d447"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:20.368222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:20.368222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:20.378397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f5629b2a-aa0d-4978-b407-748be9f16812 req-ced895b2-2ba2-4070-abd2-d7dbbb1e986e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.378890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f5629b2a-aa0d-4978-b407-748be9f16812 req-ced895b2-2ba2-4070-abd2-d7dbbb1e986e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.400840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-f5629b2a-aa0d-4978-b407-748be9f16812 req-ced895b2-2ba2-4070-abd2-d7dbbb1e986e service nova] Creating event network-changed:129af318-a8c9-45be-9c96-c02b0ea6d447 for instance 1c8e2a7c-832b-483c-b67b-c75c347370e6 on hv-cinder-75995 Feb 17 04:39:20.406001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-f5629b2a-aa0d-4978-b407-748be9f16812 req-ced895b2-2ba2-4070-abd2-d7dbbb1e986e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044484 Feb 17 04:39:20.406734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 349/713] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:20.415193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:20.416417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.428509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.429256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.430472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.431183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.547399 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-286b0f7e-3ac5-45a1-895f-cc354bed93ca tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.137926 Feb 17 04:39:20.548152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 350/714] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:20 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:20.768028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.777235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-24ccddab-50d7-4ffe-ae7f-c27e02e567aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.435750 Feb 17 04:39:20.778619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 365/715] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:20 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:21.216489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:21.217673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.226900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.227605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.228337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.228833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.354881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-42e78617-a9f6-472f-a3cd-3566bde66611 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 17914 microversion: 2.20 time: 0.142921 Feb 17 04:39:21.359122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 351/716] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:21 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 17914 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:21.559522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:21.561132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.571820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.572346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.573221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.573724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.690487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2965881a-5bfe-4e10-854f-ac963c3ad5fb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.134861 Feb 17 04:39:21.691415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 366/717] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:21 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:21.797613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:21.798551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.807791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.808304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.809147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.809695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.029364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:22.038913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fadf0ebd-4242-4fa5-a545-0620ace481aa tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.245914 Feb 17 04:39:22.039832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 352/718] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:21 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:22.368220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:22.369308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:22.378547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.378976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.379875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.380925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.508398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fccd1755-be75-4f9d-8b0b-affc4c379e55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 18663 microversion: 2.20 time: 0.145193 Feb 17 04:39:22.509125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 367/719] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:22 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 18663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:22.702518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:22.703965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:22.712833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.713877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.715087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.715672 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.843748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-01173cef-2bf8-49ac-9976-8a40bbe48b5b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.144753 Feb 17 04:39:22.844566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 353/720] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:22 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:23.058301 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:23.059220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.068826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.069328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.070200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.070694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.522949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:23.524165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.536411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.536411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.537031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.537725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.545349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:23.554586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-080e4ee6-593b-43aa-a7d9-5fb274d73efc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.500897 Feb 17 04:39:23.555457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 368/721] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:23 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:23.673490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f27931a2-7a12-4380-b0ac-b308bf38a6fb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 20991 microversion: 2.20 time: 0.155673 Feb 17 04:39:23.674585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 354/722] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:23 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 20991 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:23.855545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:23.856589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.865273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.865807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.866658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.867617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.981628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-69a73c92-609b-4106-8120-99b38be754a5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.129757 Feb 17 04:39:23.982474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 369/723] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:23 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:24.573362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:24.574053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:24.582667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:24.583716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.584560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:24.585050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.686815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:24.688534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:24.710550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:24.711438 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.712494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:24.713204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.838543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:24.848200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2d45f1f7-58a5-42ef-908f-de44e5561d63 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.279299 Feb 17 04:39:24.849858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 355/724] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:24 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:24.863634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-22f8ae3a-3907-45d5-a89c-c0d992f5982f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 22540 microversion: 2.20 time: 0.181107 Feb 17 04:39:24.864700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 370/725] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:24 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 22540 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:24.993776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:25.001000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:25.003411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.004257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.005700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.006272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.116839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-22fd9ec9-a7ae-41c0-b893-357a49db3b02 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.127049 Feb 17 04:39:25.120237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 356/726] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:24 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:25.261410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-0b29027d-4d41-4c76-a46d-97e8980febbe req-1d80e988-7fd6-4fdd-b05f-393b0dee753c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8e2a7c-832b-483c-b67b-c75c347370e6", "name": "network-vif-plugged", "status": "completed", "tag": "129af318-a8c9-45be-9c96-c02b0ea6d447"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:25.263364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:25.263364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:25.275880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0b29027d-4d41-4c76-a46d-97e8980febbe req-1d80e988-7fd6-4fdd-b05f-393b0dee753c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.276302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0b29027d-4d41-4c76-a46d-97e8980febbe req-1d80e988-7fd6-4fdd-b05f-393b0dee753c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.298137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-0b29027d-4d41-4c76-a46d-97e8980febbe req-1d80e988-7fd6-4fdd-b05f-393b0dee753c service nova] Creating event network-vif-plugged:129af318-a8c9-45be-9c96-c02b0ea6d447 for instance 1c8e2a7c-832b-483c-b67b-c75c347370e6 on hv-cinder-75995 Feb 17 04:39:25.303881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-0b29027d-4d41-4c76-a46d-97e8980febbe req-1d80e988-7fd6-4fdd-b05f-393b0dee753c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048686 Feb 17 04:39:25.304873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 371/727] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:25.880427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:25.883102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:25.886411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:25.887579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:25.899811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.900590 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.901565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.902207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.905775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.906468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.907811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.908359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.056532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-40fac36b-84d8-48f6-9614-5538c79b370f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 23797 microversion: 2.20 time: 0.183882 Feb 17 04:39:26.058014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 372/728] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:25 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 23797 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:26.129752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:26.136959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:26.138100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:26.140761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-04bffef8-8c5c-445c-8cdb-7aba6b688202 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.277402 Feb 17 04:39:26.147924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.148436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.149468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.149961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.152114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 357/729] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:25 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:26.458842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f92ca70a-e0d3-43af-af89-35271e795e87 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.324958 Feb 17 04:39:26.459613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 373/730] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:26 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:27.070056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:27.071208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.081259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.081798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.082646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.083174 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.160418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:27.161333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.171047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.171791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.172877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.173443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.245483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-91be50be-9fb1-48bb-bcea-b74c46edd710 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 24593 microversion: 2.20 time: 0.179785 Feb 17 04:39:27.247351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 358/731] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:27 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 24593 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:27.413279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.423020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5de28b21-93cd-4fe0-a0a2-60f35173fe29 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1318 microversion: 2.1 time: 0.267231 Feb 17 04:39:27.423757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 374/732] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:27 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:27.471468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:27.472619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.482234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.482693 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.483583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.484073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.597405 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e00e24b7-6698-4955-a590-1c7c910586b0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.130288 Feb 17 04:39:27.598344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 359/733] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:27 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:28.259520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:28.260585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.270389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.271474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.272338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.272943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.406518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-036be568-2ad9-4636-a948-d4538a5d5529 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 25489 microversion: 2.20 time: 0.151844 Feb 17 04:39:28.407354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 375/734] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:28 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 25489 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:28.443864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:28.444725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.454150 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.454769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.455750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.456251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.613594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:28.615531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.624696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.625215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.626085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.626584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.749014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ac8f7973-45a8-433a-981f-771084bec189 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.141765 Feb 17 04:39:28.750522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 376/735] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:28 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:28.771190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.780582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d700ac0e-db8b-4083-8f26-36e4cc02e631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1507 microversion: 2.1 time: 0.342137 Feb 17 04:39:28.781190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 360/736] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:28 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:29.420398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:29.422198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:29.431966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.432464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.433324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.433966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.577470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d5636d03-aee8-4858-9c8a-7e214838876a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 26475 microversion: 2.20 time: 0.161485 Feb 17 04:39:29.581720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 377/737] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:29 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 26475 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:29.762483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:29.763761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:29.773312 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.773861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.774960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.775652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.901411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5c66f057-2c20-4a40-a70a-f7b12d52d19f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.143047 Feb 17 04:39:29.902160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 361/738] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:29 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:30.591138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:30.592338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:30.602016 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.602207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.602923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.603454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.639768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f713258d-cf60-4abe-8328-6c91c00a8fb6"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:30.641395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:30.651106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.651925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.653134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.653833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.760204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a493946a-f660-4b99-b048-2cce82c47f73 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 27037 microversion: 2.20 time: 0.173482 Feb 17 04:39:30.764410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 378/739] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:30 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 27037 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:30.915038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:30.916226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:30.924994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.925503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.926346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.926907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.170574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-22444d1f-4aa9-4c9e-b3dd-b9a457dc89e6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14 microversion: 2.1 time: 0.260880 Feb 17 04:39:31.174374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 379/740] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:30 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:39:31.218963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-35addc2e-f0ec-416d-b07b-2fd9bdd95849 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "POST /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584164 Feb 17 04:39:31.219668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 362/741] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:30 2021] POST /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:31.773282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:31.774446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:31.785147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.785657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.787010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.787804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.925178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3aa74652-87cf-4a4d-a8b1-4fec13189990 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 27472 microversion: 2.20 time: 0.156081 Feb 17 04:39:31.926189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 380/742] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:31 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 27472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:32.183266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:32.184432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.193222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.193749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.194570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.195064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.321028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dd0ae569-f9e4-49cb-aa90-5300ea5e3abe tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 7040 microversion: 2.1 time: 0.142456 Feb 17 04:39:32.321744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 363/743] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:32 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 7040 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:32.938832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:32.940027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.949446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.949896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.950774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.951325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.088829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5559f501-0c56-4b42-85fb-3949067a6195 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 27679 microversion: 2.20 time: 0.154314 Feb 17 04:39:33.089810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 381/744] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:32 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 27679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:33.334020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:33.335084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:33.343748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.344255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.345093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.345587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.476754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-af8e134d-0875-449d-8238-8120701db60c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 14890 microversion: 2.1 time: 0.147034 Feb 17 04:39:33.477463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 364/745] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:33 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 14890 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:34.101605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:34.102673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:34.111437 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.111955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.112796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.113297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.256513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e399a911-d26f-46ba-aef9-f248de7b043e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28021 microversion: 2.20 time: 0.159345 Feb 17 04:39:34.257408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 382/746] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:34 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28021 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:34.490244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:34.491598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:34.500565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.501143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.502114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.502612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.635961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-48e8b958-790a-4288-ae18-e3b329c2a754 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 18305 microversion: 2.1 time: 0.150481 Feb 17 04:39:34.636685 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 365/747] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:34 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 18305 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:35.269970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:35.271667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.280382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.280913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.283851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.283851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.409507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d5887fa2-ce0b-42bf-8072-abf6357783b3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28207 microversion: 2.20 time: 0.143750 Feb 17 04:39:35.410221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 383/748] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:35 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28207 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:35.651583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:35.652888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.661814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.662582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.663493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.663990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.784154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8124c29e-69f0-41bd-b033-fd360cc76f7d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 19096 microversion: 2.1 time: 0.137921 Feb 17 04:39:35.784874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 366/749] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:35 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 19096 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:36.424058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:36.425257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:36.434226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.434739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.435782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.436272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.568310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ef6611a2-4aae-4bfe-a9a7-d4ddc5005792 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28498 microversion: 2.20 time: 0.148849 Feb 17 04:39:36.569709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 384/750] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:36 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:36.797240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:36.798621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:36.810480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.811104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.812083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.812584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.948482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3b180941-78c1-4115-9a3b-bb6dd955a93c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 20997 microversion: 2.1 time: 0.155500 Feb 17 04:39:36.949201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 367/751] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:36 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 20997 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:37.582367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:37.584092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:37.592797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.593313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.594149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.594771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.714005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9e79222c-4d8d-4365-aced-58b7f5de3bb3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28498 microversion: 2.20 time: 0.135891 Feb 17 04:39:37.715629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 385/752] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:37 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28498 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:37.964753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:37.965926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:37.974059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.974597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.975445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.975938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.106690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8d624ca0-807d-4fc7-8cea-a70587d0711d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 22806 microversion: 2.1 time: 0.146906 Feb 17 04:39:38.107436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 368/753] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:37 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 22806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:38.731343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:38.732967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:38.746313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.747143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.748037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.748542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.881826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b3663dc6-8838-4d6b-944a-2f68d15c91f2 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28666 microversion: 2.20 time: 0.156626 Feb 17 04:39:38.882819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 386/754] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:38 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:39.123537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:39.124774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.138914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.139867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.141239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.141949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.262929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-76c4d8d2-aac1-4944-8e45-2807643e6cec tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 24007 microversion: 2.1 time: 0.145213 Feb 17 04:39:39.266333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 369/755] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:39 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 24007 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:39.321337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:39.322000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.335211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.336058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.337476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.338283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.521503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lazy-loading 'services' on Instance uuid 1c8e2a7c-832b-483c-b67b-c75c347370e6 {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:39.747509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b317e5da-f1c7-45fc-9d05-d2d28a534254 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6/os-volume_attachments/f713258d-cf60-4abe-8328-6c91c00a8fb6" status: 202 len: 0 microversion: 2.1 time: 0.433191 Feb 17 04:39:39.748718 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 387/756] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:39:39 2021] DELETE /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6/os-volume_attachments/f713258d-cf60-4abe-8328-6c91c00a8fb6 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:39.896597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:39.897773 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.906789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.907352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.908194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.908695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.024161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a9669343-5eba-4e4e-83de-7d6754dcb03d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28666 microversion: 2.20 time: 0.131943 Feb 17 04:39:40.024796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 370/757] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:39 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28666 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:40.278786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:40.279919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:40.289194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.289698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.290548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.291041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.417023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dc35f7f6-e328-4da2-8ed3-fd92bfb4e8f0 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 25495 microversion: 2.1 time: 0.142775 Feb 17 04:39:40.417744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 388/758] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:40 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 25495 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:41.038832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:41.040840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.050545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.051407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.052772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.053459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.164722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-522d54fb-c077-46ce-b90d-07f1be855886 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28666 microversion: 2.20 time: 0.130500 Feb 17 04:39:41.165701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 371/759] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:41 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28666 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:41.431189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:41.432296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.441250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.441837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.442789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.443317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.579238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c0f796cd-e1c6-4113-b9d8-122e7200b936 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 26566 microversion: 2.1 time: 0.152627 Feb 17 04:39:41.580899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 389/760] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:41 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 26566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:42.178373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:42.179574 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.188276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.188786 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.189682 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.190186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.313319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8de115d9-2fe6-40ca-808d-b131d90e17df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28666 microversion: 2.20 time: 0.139383 Feb 17 04:39:42.314035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 372/761] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:42 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28666 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:42.422204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:42.422855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.432115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.432525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.433388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.433889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.504154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:39:42.593874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:42.600660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.604025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.604536 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.605398 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.605892 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.735087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e1ef2b05-8485-4c8b-aba3-c3b81dd0f1d9 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 204 len: 0 microversion: 2.1 time: 0.317271 Feb 17 04:39:42.735797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 390/762] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:39:42 2021] DELETE /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:39:42.746097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:42.751727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.752665 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c171507a-aa86-43cb-843b-3ddad605793f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 27405 microversion: 2.1 time: 0.163193 Feb 17 04:39:42.753654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 373/763] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:42 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 27405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:42.755927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.756439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.757307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.757801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.988428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:43.005867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9edbabdb-d192-4dd0-b295-0281b9c9a018 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1513 microversion: 2.1 time: 0.263554 Feb 17 04:39:43.006958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 391/764] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:42 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:43.329255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:43.330291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:43.339146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.339690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.340527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.341015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.456136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4904b4bf-aa0a-410c-b0c8-23319e449d92 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 28666 microversion: 2.20 time: 0.131527 Feb 17 04:39:43.457004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 374/765] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:43 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 28666 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:43.774091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:43.776044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:43.792723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.793402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.794723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.795571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.948615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-aa937dd0-ee3b-42ad-8600-f4fe73616c79 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 27824 microversion: 2.1 time: 0.181514 Feb 17 04:39:43.949391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 392/766] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:43 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 27824 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:44.025167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:44.025949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:44.035420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.036403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.037535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.038033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.284129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:44.294527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3c4f9b2d-57d9-43b6-8d17-13f2f260f67a tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1513 microversion: 2.1 time: 0.273885 Feb 17 04:39:44.295141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 375/767] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:44 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:44.471576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:44.472643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:44.482923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.483481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.484320 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.484813 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.623189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7022c1ee-de39-43e5-8c8d-b3109abe8947 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 29452 microversion: 2.20 time: 0.156054 Feb 17 04:39:44.623944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 393/768] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:44 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 29452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:44.961658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:44.962725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:44.970867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.971449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.972300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.972795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.099236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0724e5f8-6d98-481f-bef1-e64e81cdf0e9 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28057 microversion: 2.1 time: 0.141003 Feb 17 04:39:45.101869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 376/769] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:44 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28057 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:45.314870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:45.316188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.328056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.328652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.329642 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.330295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.598204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:45.610739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dad87f79-11b8-4fcc-bda9-0d7b4c5a53cd tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1513 microversion: 2.1 time: 0.301743 Feb 17 04:39:45.611662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 394/770] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:45 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:45.637404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:45.638649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.648223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.648728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.649624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.650106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.804907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-bba9ff91-b02c-4a47-9df2-7a19967afe1b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 31117 microversion: 2.20 time: 0.171870 Feb 17 04:39:45.807365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 377/771] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:45 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 31117 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:46.117212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:46.118753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.130704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.131205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.132093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.132585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.190627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-997b8f5a-33ad-450b-9e86-99fb3d784da7 req-c4938724-6608-438b-a4d6-b127d6bed9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8e2a7c-832b-483c-b67b-c75c347370e6", "name": "network-vif-deleted", "tag": "129af318-a8c9-45be-9c96-c02b0ea6d447"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:46.193671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:46.193671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:46.205328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-997b8f5a-33ad-450b-9e86-99fb3d784da7 req-c4938724-6608-438b-a4d6-b127d6bed9e9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.205840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-997b8f5a-33ad-450b-9e86-99fb3d784da7 req-c4938724-6608-438b-a4d6-b127d6bed9e9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.224647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-997b8f5a-33ad-450b-9e86-99fb3d784da7 req-c4938724-6608-438b-a4d6-b127d6bed9e9 service nova] Creating event network-vif-deleted:129af318-a8c9-45be-9c96-c02b0ea6d447 for instance 1c8e2a7c-832b-483c-b67b-c75c347370e6 on hv-cinder-75995 Feb 17 04:39:46.229755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-997b8f5a-33ad-450b-9e86-99fb3d784da7 req-c4938724-6608-438b-a4d6-b127d6bed9e9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271908 Feb 17 04:39:46.230425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 395/772] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:46.281635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-46441935-8241-4864-ade6-416336919cfb tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28244 microversion: 2.1 time: 0.171718 Feb 17 04:39:46.282387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 378/773] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:46 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:46.638848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:46.639778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.652168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.652746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.653945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.654655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.738752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.739272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.739803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lazy-loading 'fault' on Instance uuid 1c8e2a7c-832b-483c-b67b-c75c347370e6 {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:46.806600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:46.821919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dcb1a8f0-f8c5-41e5-b72d-5608dab607fc tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 200 len: 1308 microversion: 2.1 time: 0.188157 Feb 17 04:39:46.822146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:46.823262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 396/774] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:46 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:46.823517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.832414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.833516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.834379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.834874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.969032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2eb3cea7-845b-4768-9f44-ac7897603894 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 32459 microversion: 2.20 time: 0.151951 Feb 17 04:39:46.972645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 379/775] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:46 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 32459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:39:47.295861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:47.296898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.304925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.305432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.306266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.306756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.416651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-11d7ecb3-80bb-4e8f-9169-b1a685d4673a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28244 microversion: 2.1 time: 0.125126 Feb 17 04:39:47.417378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 397/776] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:47 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:47.842298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:47.843068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 1c8e2a7c-832b-483c-b67b-c75c347370e6] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.851891 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.852395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.853249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.853746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.910873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] HTTP exception thrown: Instance 1c8e2a7c-832b-483c-b67b-c75c347370e6 could not be found. Feb 17 04:39:47.911728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Returning 404 to user: Instance 1c8e2a7c-832b-483c-b67b-c75c347370e6 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:47.912905 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b9ff75f7-7b9d-4aa8-be75-2e91495bc216 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6" status: 404 len: 111 microversion: 2.1 time: 0.075257 Feb 17 04:39:47.913529 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 380/777] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:47 2021] GET /compute/v2.1/servers/1c8e2a7c-832b-483c-b67b-c75c347370e6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:39:47.982673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:47.983868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:48.029641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.029641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.029641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.029641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.133486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1685759a-2ade-49d5-b278-0e1524b92683 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 33425 microversion: 2.20 time: 0.155370 Feb 17 04:39:48.134196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 398/778] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:47 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 33425 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:48.430050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:48.430994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:48.439027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.439566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.440440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.440926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.568000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c3b369df-1cc2-44f3-87f7-04ae05b14f0a tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28535 microversion: 2.1 time: 0.142334 Feb 17 04:39:48.569089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 381/779] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:48 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28535 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:49.148579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:49.149867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.158946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.159489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.160368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.161427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.257913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:49.258685 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.267419 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.267928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.268779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.270135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.293913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-be88c865-b0f3-4821-8040-fe581b91854e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 34164 microversion: 2.20 time: 0.150656 Feb 17 04:39:49.295327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 399/780] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:49 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 34164 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:49.341957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:39:49.581735 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:49.583472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.592338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.592854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.593722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.594265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.723649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e8d628a8-6327-4816-8ba7-b48b7e67c0c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 204 len: 0 microversion: 2.1 time: 0.472206 Feb 17 04:39:49.724343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 382/781] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:39:49 2021] DELETE /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:39:49.734117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:49.734882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.735169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3e0858c3-9808-46e0-ad80-af7d3c33a569 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28703 microversion: 2.1 time: 0.157736 Feb 17 04:39:49.736176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 400/782] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:49 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28703 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:49.743445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.743964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.744824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.745473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.017653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:50.027755 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f9a1f038-030d-42cc-b83a-2f8b7b2fc43f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1512 microversion: 2.1 time: 0.298740 Feb 17 04:39:50.028338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 383/783] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:49 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:50.310018 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:50.311141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:50.320849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.321358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.322239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.322729 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.442280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-702a77a4-a985-4ae6-92b4-00e91e1d69cb tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 35108 microversion: 2.20 time: 0.136592 Feb 17 04:39:50.442994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 401/784] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:50 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 35108 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:50.749412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:50.750594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:50.759751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.760266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.761109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.761752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.869579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9e3545de-c7cd-4c20-b7b4-18a2977047cf tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28703 microversion: 2.1 time: 0.124943 Feb 17 04:39:50.870279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 384/785] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:50 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28703 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:51.047739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:51.048436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.057276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.057801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.058667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.059165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.283539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:51.292867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ef453a66-864c-445d-b773-a04dc0d60588 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1512 microversion: 2.1 time: 0.250013 Feb 17 04:39:51.293475 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 402/786] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:51 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:51.455484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:51.456659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.466139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.466649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.467554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.468047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.588761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a7b31256-2bd6-4161-a8c6-093ad937eab8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 36039 microversion: 2.20 time: 0.137780 Feb 17 04:39:51.589480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 385/787] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:51 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 36039 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:51.882065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:51.883533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.891771 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.892287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.893139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.893646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.003644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3cc92bc4-0f63-4719-ab2a-31136df41e93 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28703 microversion: 2.1 time: 0.125271 Feb 17 04:39:52.008354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 403/788] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:51 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28703 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:52.313301 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:52.314238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.323769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.324389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.325324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.326130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.603638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:52.604582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.613738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.614291 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.615149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.615693 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.745977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6636c5d1-a2db-4121-9d37-0662531dffb7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 37424 microversion: 2.20 time: 0.147607 Feb 17 04:39:52.746706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 404/789] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:52 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 37424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:39:52.878354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:52.888171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5f48c1b6-2d6f-497a-9d20-76c4846cdb1f tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 200 len: 1470 microversion: 2.1 time: 0.580910 Feb 17 04:39:52.899943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 386/790] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:52 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 1470 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:53.012676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-f33e118a-c07a-40ff-9bd4-4dddecc1f6e5 req-766c0f0b-4809-41a5-bcd2-f4e60cad1b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebeed2ab-885b-4680-a4f0-19c53a6afd8b", "name": "network-vif-deleted", "tag": "cdc7a4d3-07bb-42ba-b6af-ec8e047f2096"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:53.014478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:53.014478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:53.016685 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:53.017734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:53.024604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f33e118a-c07a-40ff-9bd4-4dddecc1f6e5 req-766c0f0b-4809-41a5-bcd2-f4e60cad1b64 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.025136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f33e118a-c07a-40ff-9bd4-4dddecc1f6e5 req-766c0f0b-4809-41a5-bcd2-f4e60cad1b64 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.025995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.026112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.026916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.027601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.048696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-f33e118a-c07a-40ff-9bd4-4dddecc1f6e5 req-766c0f0b-4809-41a5-bcd2-f4e60cad1b64 service nova] Creating event network-vif-deleted:cdc7a4d3-07bb-42ba-b6af-ec8e047f2096 for instance ebeed2ab-885b-4680-a4f0-19c53a6afd8b on hv-cinder-75995 Feb 17 04:39:53.054916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-f33e118a-c07a-40ff-9bd4-4dddecc1f6e5 req-766c0f0b-4809-41a5-bcd2-f4e60cad1b64 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047101 Feb 17 04:39:53.055637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 405/791] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:53.142998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3d0a4711-dfd8-439e-a18d-c33dba5928da tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 28703 microversion: 2.1 time: 0.129230 Feb 17 04:39:53.144718 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 387/792] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:53 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 28703 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:53.766264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:53.767607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:53.783053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.783676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.784560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.785058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.907401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:53.908158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: ebeed2ab-885b-4680-a4f0-19c53a6afd8b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:53.917712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.918019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b351fda6-6112-4091-b774-d9ecfc9caf9b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 38212 microversion: 2.20 time: 0.160760 Feb 17 04:39:53.918217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.918561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 406/793] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:53 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 38212 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:53.919080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.919621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.977848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] HTTP exception thrown: Instance ebeed2ab-885b-4680-a4f0-19c53a6afd8b could not be found. Feb 17 04:39:53.978513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Returning 404 to user: Instance ebeed2ab-885b-4680-a4f0-19c53a6afd8b could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:53.979451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d11f6831-ce22-4d9e-9544-32312139fd22 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b" status: 404 len: 111 microversion: 2.1 time: 0.076778 Feb 17 04:39:53.980080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 388/794] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:53 2021] GET /compute/v2.1/servers/ebeed2ab-885b-4680-a4f0-19c53a6afd8b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:39:53.990029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:53.990689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:53.999660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.000193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.001054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.001552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.070006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:39:54.157948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:54.157948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:54.165783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.166391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.167228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.167745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.292886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7996d3ad-db69-470e-af01-0f19cd6bbc01 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 30474 microversion: 2.1 time: 0.140155 Feb 17 04:39:54.294161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 389/795] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:54 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 30474 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:54.368894 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5a9d6247-d4ce-48d2-86e2-fec0cde73503 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 204 len: 0 microversion: 2.1 time: 0.383527 Feb 17 04:39:54.369570 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 407/796] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:39:53 2021] DELETE /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:39:54.379968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:54.380743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:54.389585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.390092 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.390926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.391443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.670793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:54.680201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4f62c83b-644a-47ec-9c15-873d661c9381 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1514 microversion: 2.1 time: 0.304779 Feb 17 04:39:54.680995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 390/797] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:54 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:54.932477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:54.933531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:54.941397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.942409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.943245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.943764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.052011 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8291f0b3-b94a-4f05-a858-0c5605c8c46e tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 38212 microversion: 2.20 time: 0.123892 Feb 17 04:39:55.055942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 408/798] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:54 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 38212 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:39:55.306302 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:55.307386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:55.315259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.315822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.316666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.317780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.438652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4e10c810-c48b-42f3-a565-f12a71e08c22 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 31891 microversion: 2.1 time: 0.136076 Feb 17 04:39:55.439404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 391/799] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:55 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 31891 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:55.701380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:55.702151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:55.711295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.711817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.712677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.713204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.942602 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:55.952542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-feb04de6-8afc-45d3-b5e4-e2fb87d822ff tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1514 microversion: 2.1 time: 0.255502 Feb 17 04:39:55.953095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 409/800] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:55 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:56.066018 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:56.067212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:56.076097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.076618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.077478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.077978 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.190415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a686bcdd-fb30-4e54-920e-f74347032c04 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 38212 microversion: 2.20 time: 0.128899 Feb 17 04:39:56.191108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 392/801] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:56 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 38212 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:56.452223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:56.453271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:56.469646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.476341 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.476341 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.476341 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.545736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-5f89e0b0-67ff-4993-94bd-0fab4e2c20ea req-8085924d-4792-45ab-be17-d625b884a37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c8d1b1-cbc5-437c-8e77-b69838822e7b", "name": "network-vif-unplugged", "status": "completed", "tag": "40c6a7ff-cac8-485d-9c88-0e660a3d4fed"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:56.547780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:56.547780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:56.557634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-5f89e0b0-67ff-4993-94bd-0fab4e2c20ea req-8085924d-4792-45ab-be17-d625b884a37e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.558147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-5f89e0b0-67ff-4993-94bd-0fab4e2c20ea req-8085924d-4792-45ab-be17-d625b884a37e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.576817 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-5f89e0b0-67ff-4993-94bd-0fab4e2c20ea req-8085924d-4792-45ab-be17-d625b884a37e service nova] Creating event network-vif-unplugged:40c6a7ff-cac8-485d-9c88-0e660a3d4fed for instance 36c8d1b1-cbc5-437c-8e77-b69838822e7b on hv-cinder-75995 Feb 17 04:39:56.582123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-5f89e0b0-67ff-4993-94bd-0fab4e2c20ea req-8085924d-4792-45ab-be17-d625b884a37e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125406 Feb 17 04:39:56.583571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 393/802] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:56.594840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6a739e9b-7a1c-4790-8446-8924b09b03ed tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 32941 microversion: 2.1 time: 0.145735 Feb 17 04:39:56.595866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 410/803] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:56 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 32941 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:56.970555 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:56.971332 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:56.979470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.979976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.980952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.981443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.205766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:57.206917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:57.215944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.216461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.217548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.217831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.338539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4f096945-31f1-4c09-9ca7-871542266ba3 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 200 len: 38355 microversion: 2.20 time: 0.137085 Feb 17 04:39:57.340315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 411/804] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:57 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 38355 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:57.350688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:57.351364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:57.360272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.360782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.361652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.362147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.424845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:57.425741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-38535925-c20c-47bb-96c8-2daf9b60315d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/ips" status: 200 len: 152 microversion: 2.20 time: 0.079610 Feb 17 04:39:57.427560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 412/805] 10.222.0.73 () {60 vars in 1279 bytes} [Wed Feb 17 04:39:57 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/ips => generated 152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:57.434884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b8c5d3bd-77d6-4502-afcf-d7d4b85dcb09 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1514 microversion: 2.1 time: 0.468707 Feb 17 04:39:57.435701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 394/806] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:56 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1514 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:57.607883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:57.609035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:57.617861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.618620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.619164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.619689 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.739059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f88470e6-a7d8-4aaa-906d-2deb39aa4df6 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 33887 microversion: 2.1 time: 0.134562 Feb 17 04:39:57.739832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 413/807] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:57 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 33887 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:58.180232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-41eb98c1-ef57-433d-87a2-81b7ba27ebde req-c51a5838-32ce-4d2a-94f1-eba1a96e90c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c8d1b1-cbc5-437c-8e77-b69838822e7b", "name": "network-vif-deleted", "tag": "40c6a7ff-cac8-485d-9c88-0e660a3d4fed"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:58.181989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:58.181989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:39:58.192363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-41eb98c1-ef57-433d-87a2-81b7ba27ebde req-c51a5838-32ce-4d2a-94f1-eba1a96e90c7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.192860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-41eb98c1-ef57-433d-87a2-81b7ba27ebde req-c51a5838-32ce-4d2a-94f1-eba1a96e90c7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.210654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-41eb98c1-ef57-433d-87a2-81b7ba27ebde req-c51a5838-32ce-4d2a-94f1-eba1a96e90c7 service nova] Creating event network-vif-deleted:40c6a7ff-cac8-485d-9c88-0e660a3d4fed for instance 36c8d1b1-cbc5-437c-8e77-b69838822e7b on hv-cinder-75995 Feb 17 04:39:58.217337 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-41eb98c1-ef57-433d-87a2-81b7ba27ebde req-c51a5838-32ce-4d2a-94f1-eba1a96e90c7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041436 Feb 17 04:39:58.218358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 395/808] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:58.454759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:58.455557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:58.464745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.465254 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.466099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.466571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.540825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.541336 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.541844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lazy-loading 'fault' on Instance uuid 36c8d1b1-cbc5-437c-8e77-b69838822e7b {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:58.611204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:58.620688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-546fd78b-021e-4079-aa5a-718e6ba2b7c4 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 200 len: 1308 microversion: 2.1 time: 0.170349 Feb 17 04:39:58.621321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 414/809] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:58 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:58.753492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:58.755151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:58.763315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.763819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.764650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.765178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.887088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-eef17f0c-72fd-4967-bd9e-50c7f6c5fd9c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 35162 microversion: 2.1 time: 0.138019 Feb 17 04:39:58.887848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 396/810] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:58 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 35162 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:59.638823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:59.639531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: 36c8d1b1-cbc5-437c-8e77-b69838822e7b] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:59.652904 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.653774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.655253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.655946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.717139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] HTTP exception thrown: Instance 36c8d1b1-cbc5-437c-8e77-b69838822e7b could not be found. Feb 17 04:39:59.717810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Returning 404 to user: Instance 36c8d1b1-cbc5-437c-8e77-b69838822e7b could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:59.718899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cd5062bb-bb6a-4ce5-b109-1318257ec0b0 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b" status: 404 len: 111 microversion: 2.1 time: 0.084131 Feb 17 04:39:59.719411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 415/811] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:59 2021] GET /compute/v2.1/servers/36c8d1b1-cbc5-437c-8e77-b69838822e7b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:39:59.906694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:59.908220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:59.919908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.920424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.921287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.921784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.922780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:59.924085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:59.933900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.934524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.938845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.938845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.013531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lazy-loading 'flavor' on Instance uuid 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:00.060856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6ea38a76-2cfe-44a1-ae8a-f112a67aa07c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 36666 microversion: 2.1 time: 0.163137 Feb 17 04:40:00.061651 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 397/812] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:59 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 36666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:40:00.620255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1493741b-3ad5-4d5c-8ccb-1e5efa285157 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 202 len: 0 microversion: 2.20 time: 0.704957 Feb 17 04:40:00.620862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 416/813] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:59 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:00.633219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:00.634519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:00.646818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.647668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.649124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.649942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.877611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:00.887628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:00.889223 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:00.890434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-20a7eba4-dd6d-4ba8-8afc-3c491b403dec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.264310 Feb 17 04:40:00.891039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 398/814] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:00 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:01.039255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:01.039951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.049091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.049611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.050470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.050989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.076173 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:01.077427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.086272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.086775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.087643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.088128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.120695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:01.227241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a7df12a8-233d-4beb-9c74-bffbd096a223 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 38069 microversion: 2.1 time: 0.154810 Feb 17 04:40:01.228927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 399/815] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:01 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 38069 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:40:01.363215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-16e28436-6208-4104-96fe-49df6b32b20c tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 204 len: 0 microversion: 2.1 time: 0.329042 Feb 17 04:40:01.363915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 417/816] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:01 2021] DELETE /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:01.373078 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:01.376583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.382699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.383237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.384105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.384589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.655537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:01.666656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7da21403-7997-4dbc-95b9-e3ca5c1ed7c8 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1512 microversion: 2.1 time: 0.297997 Feb 17 04:40:01.669579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 400/817] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:01 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:01.912359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:01.913132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.921108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.921622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.922452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.922946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.138994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:02.148827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:02.150426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:02.151653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9fcb2af4-f05e-4c86-a7df-4394fe153f2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.245064 Feb 17 04:40:02.152248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 418/818] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:01 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:02.242023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:02.243074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:02.251492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.251991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.252839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.253326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.371534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5c38cb6a-53c3-4cb5-9387-ae5f6a9d4c4e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 38230 microversion: 2.1 time: 0.133816 Feb 17 04:40:02.372235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 401/819] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:02 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 38230 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:40:02.685369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:02.686126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:02.694193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.694697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.695563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.696055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.920501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:02.929486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5652d63c-34c4-4960-bfb1-01b02db25631 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1512 microversion: 2.1 time: 0.248169 Feb 17 04:40:02.930106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 419/820] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:02 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:03.172599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:03.173411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:03.182497 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.183001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.183893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.184388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.384914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:03.386098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:03.394380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.395628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.396527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.397049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.502802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-33f503e3-da8a-443e-856c-4f233471a759 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 38230 microversion: 2.1 time: 0.121767 Feb 17 04:40:03.505086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 420/821] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:03 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 38230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:40:03.658079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.670674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.672357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.673706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-04126e2c-570b-48fa-8c21-95b94a6c045f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.505722 Feb 17 04:40:03.674488 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 402/822] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:03 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:03.949048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:03.949812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:03.964955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.966917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.969137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.969876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.109559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1261a734684bc6bfde7bb9395be18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485e107aac5140888157d73b3f00eca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.121746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d6616fca-0c74-451d-9b4f-a149e103c531 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 200 len: 1470 microversion: 2.1 time: 0.177110 Feb 17 04:40:04.122624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 421/823] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:03 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:04.362636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-45f4edce-9afa-420a-81d8-d6ac8d2afdbd req-2167ca70-d505-4d40-8892-28e2cc1bcdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0da21aa-1ab0-4752-b15a-194a6de5adf8", "name": "network-vif-deleted", "tag": "8600f1f1-a316-4a18-a5ae-51e52c74e16e"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:04.364355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:04.364355 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:40:04.377545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-45f4edce-9afa-420a-81d8-d6ac8d2afdbd req-2167ca70-d505-4d40-8892-28e2cc1bcdf5 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.378010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-45f4edce-9afa-420a-81d8-d6ac8d2afdbd req-2167ca70-d505-4d40-8892-28e2cc1bcdf5 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.396156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-45f4edce-9afa-420a-81d8-d6ac8d2afdbd req-2167ca70-d505-4d40-8892-28e2cc1bcdf5 service nova] Creating event network-vif-deleted:8600f1f1-a316-4a18-a5ae-51e52c74e16e for instance d0da21aa-1ab0-4752-b15a-194a6de5adf8 on hv-cinder-75995 Feb 17 04:40:04.401308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-45f4edce-9afa-420a-81d8-d6ac8d2afdbd req-2167ca70-d505-4d40-8892-28e2cc1bcdf5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042838 Feb 17 04:40:04.401995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 403/824] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:04.517004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:04.518232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:04.527553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.528145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.529037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.529569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.650668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-19f4be00-fc59-478a-952d-23f0d8f09198 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 38230 microversion: 2.1 time: 0.137914 Feb 17 04:40:04.651844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 422/825] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:04 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 38230 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:40:04.696098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:04.696870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:04.705189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.705706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.706556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.707056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.930229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.940271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.942465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.943734 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1bf63603-ef0b-4ea9-8928-42fac9382a84 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.253003 Feb 17 04:40:04.944366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 404/826] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:04 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:05.141097 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:05.141864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] [instance: d0da21aa-1ab0-4752-b15a-194a6de5adf8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.150815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.151349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.152248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.152752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.207317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] HTTP exception thrown: Instance d0da21aa-1ab0-4752-b15a-194a6de5adf8 could not be found. Feb 17 04:40:05.208000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] Returning 404 to user: Instance d0da21aa-1ab0-4752-b15a-194a6de5adf8 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:05.208895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-71d990bc-7fe9-4d58-b261-c979cbfde4c6 tempest-AttachVolumeNegativeTest-1689621499 tempest-AttachVolumeNegativeTest-1689621499-project] 10.222.0.73 "GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8" status: 404 len: 111 microversion: 2.1 time: 0.072449 Feb 17 04:40:05.209524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 423/827] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:05 2021] GET /compute/v2.1/servers/d0da21aa-1ab0-4752-b15a-194a6de5adf8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:05.665728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:05.666820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.676941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.677470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.678334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.678829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.795427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-78d3b9ae-c46a-4851-8a6d-4b541dbf1bb2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action" status: 200 len: 38359 microversion: 2.1 time: 0.133761 Feb 17 04:40:05.799419 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 405/828] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:05 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/action => generated 38359 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:40:05.807840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:05.809065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.817726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.818242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.819151 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.819683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.891038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2f86ad8f-4ebe-4148-98d3-fbe49e1bf554 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/ips" status: 200 len: 146 microversion: 2.1 time: 0.087372 Feb 17 04:40:05.891705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 424/829] 10.222.0.73 () {58 vars in 1238 bytes} [Wed Feb 17 04:40:05 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/ips => generated 146 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:05.965660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:05.968512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.976331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.977050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.977980 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.978478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.346456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:06.361758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:06.363381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:06.364776 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ee52a615-12d4-44cc-a6ed-26cc4e04c875 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.403729 Feb 17 04:40:06.365229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 406/830] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:05 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:07.384617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:07.385282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:07.393982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.394484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.395887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.396380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.626220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.636396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.637866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.639068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-25d6c58e-9e85-4b34-8080-0b504e9ae804 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.258684 Feb 17 04:40:07.639691 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 425/831] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:07 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:07.674293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa3ea68c-7d21-413c-bba1-fe4a301b0b88"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:07.675525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:07.685053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.686180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.687041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.687565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.544276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e0a36687-5da4-4332-98a0-c4ceb0ae49ff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873837 Feb 17 04:40:08.547427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 407/832] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:40:07 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments => generated 194 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:08.659539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:08.659863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:08.677455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.677972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.678840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.679361 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.918660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.929071 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.930782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.931848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e1666f2e-7dc8-4328-b190-ef90b403b468 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.276925 Feb 17 04:40:08.932463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 426/833] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:08 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:09.954763 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:09.955620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:09.965296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.965864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.966725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.967218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.173636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e3ad9aed-6c60-49c3-beff-6c01449c1c61 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Action: 'create', calling method: .version_select at 0x7f9b2fdbf1e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-340261498", "metadata": {"Type": "work"}}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:10.197126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.207821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.209406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.210635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e6ce4af9-227e-4b8d-8d28-0600ddfd88c8 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.261406 Feb 17 04:40:10.211215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 408/834] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:09 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:10.932977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e3ad9aed-6c60-49c3-beff-6c01449c1c61 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.906310 Feb 17 04:40:10.933780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 427/835] 10.222.0.73 () {60 vars in 1146 bytes} [Wed Feb 17 04:40:10 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 908 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 17 04:40:10.945879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1b46ebb1-e7ec-41da-a761-f1ae946b4a5c tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Calling method '.version_select at 0x7f9b3d229400>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.049815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1b46ebb1-e7ec-41da-a761-f1ae946b4a5c tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1" status: 200 len: 352 microversion: 2.1 time: 0.107985 Feb 17 04:40:11.050453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 409/836] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:40:10 2021] GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:11.230415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.231116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:11.240294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.240809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.241662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.242158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.463245 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.472881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.474540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.475791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-72ab902c-0b92-4598-a83f-e884f7a9c8dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1745 microversion: 2.20 time: 0.249566 Feb 17 04:40:11.476392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 428/837] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:11 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:12.064639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a5d15a68-bc80-4b8f-9f59-5847747acdc0 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Calling method '.version_select at 0x7f9b411e91e0>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.177464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a5d15a68-bc80-4b8f-9f59-5847747acdc0 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1" status: 200 len: 353 microversion: 2.1 time: 0.116370 Feb 17 04:40:12.178701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 410/838] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:40:12 2021] GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:12.195303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b815cfdf-4b20-4da2-aa8d-d3ae5f175744 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Calling method '.version_select at 0x7f9b3c9752f0>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.306743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b815cfdf-4b20-4da2-aa8d-d3ae5f175744 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1" status: 200 len: 353 microversion: 2.1 time: 0.118053 Feb 17 04:40:12.307708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 429/839] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:40:12 2021] GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:12.326726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0b16c125-1538-4c8e-b0c6-66132bc85b81 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Calling method '.version_select at 0x7f9b411e9400>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.496241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.496972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:12.506430 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0b16c125-1538-4c8e-b0c6-66132bc85b81 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1" status: 202 len: 0 microversion: 2.1 time: 0.183511 Feb 17 04:40:12.507175 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 411/840] 10.222.0.73 () {58 vars in 1238 bytes} [Wed Feb 17 04:40:12 2021] DELETE /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:12.508021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.508548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.509431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.509934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.515532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fcf31c07-3461-4f28-ba09-2cd3bd210633 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Calling method '.version_select at 0x7f9b3d229b70>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.619144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fcf31c07-3461-4f28-ba09-2cd3bd210633 tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1" status: 200 len: 352 microversion: 2.1 time: 0.107447 Feb 17 04:40:12.619903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 412/841] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:40:12 2021] GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:12.756911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:12.766406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:12.768067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:12.769211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-06a736fd-d9d5-4efa-87cc-c570e8ee2334 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1745 microversion: 2.20 time: 0.277274 Feb 17 04:40:12.770295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 430/842] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:12 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1745 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:13.633460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-204cf935-787d-46a1-a19d-0ebf444905df tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Calling method '.version_select at 0x7f9b3c0f7400>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:13.702358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-204cf935-787d-46a1-a19d-0ebf444905df tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] HTTP exception thrown: Volume fb93013c-1635-4511-9354-351e493353c1 could not be found. Feb 17 04:40:13.703136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-204cf935-787d-46a1-a19d-0ebf444905df tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] Returning 404 to user: Volume fb93013c-1635-4511-9354-351e493353c1 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:13.704091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-204cf935-787d-46a1-a19d-0ebf444905df tempest-VolumesGetTestJSON-92021194 tempest-VolumesGetTestJSON-92021194-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1" status: 404 len: 109 microversion: 2.1 time: 0.075213 Feb 17 04:40:13.705149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 413/843] 10.222.0.73 () {58 vars in 1235 bytes} [Wed Feb 17 04:40:13 2021] GET /compute/v2.1/os-volumes/fb93013c-1635-4511-9354-351e493353c1 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:13.789948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:13.790599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:13.799745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.800521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.802065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.802887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.069838 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.080742 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.085350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.086977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5aba60e5-7c8e-41b9-af2f-5a65f15e81db tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.301865 Feb 17 04:40:14.087618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 431/844] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:13 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:15.115067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:15.115839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:15.129210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.129746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.131263 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.131820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.389989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:15.402283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:15.404610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:15.406196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5085c58c-0b99-40a7-8968-e4eed22e5f0f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.299814 Feb 17 04:40:15.407316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 414/845] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:15 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:16.435730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:16.437792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:16.455149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.456379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.458102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.459179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.544521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:16.547525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:16.568297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.569611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.571240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.572163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.701754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9c512063-5edd-4811-86ce-9ab46f8b2327 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170130 Feb 17 04:40:16.702605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 415/846] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:40:16 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:16.718019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:16.719512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:16.729379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.730975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.732420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.733494 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.810929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.817335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c799de1e-0ae3-484b-ae13-7dbf03f9d3c7 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/fa3ea68c-7d21-413c-bba1-fe4a301b0b88" status: 200 len: 194 microversion: 2.1 time: 0.104763 Feb 17 04:40:16.818037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 416/847] 10.222.0.73 () {58 vars in 1403 bytes} [Wed Feb 17 04:40:16 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/fa3ea68c-7d21-413c-bba1-fe4a301b0b88 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:16.823043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.824938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.826232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-381e26ca-46c6-4388-8c3d-7997b3303165 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.396550 Feb 17 04:40:16.826897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 432/848] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:16 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:17.849752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:17.850537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:17.873088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.874246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.875380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.876051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.184065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.196047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.197931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.199380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-23501a04-c436-41e5-a4d5-6c242694280a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.355435 Feb 17 04:40:18.200449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 417/849] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:17 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:18.697517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "772d52c6-3659-4a8f-aa00-131b97afebb5"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:18.699029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:18.708321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.708833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.709882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.710562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:19.229748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:19.231758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:19.241677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:19.242190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:19.243039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:19.243766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:19.545315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:19.556461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:19.558864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:19.560241 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-47093d3c-c638-48f7-a181-4274e7f5c38c tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.337677 Feb 17 04:40:19.563342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 418/850] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:19 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:19.605215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c676a618-435c-4ddf-a7fe-060e531cc255 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911575 Feb 17 04:40:19.605886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 433/851] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:40:18 2021] POST /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:20.594840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:20.595566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:20.603946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.604454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.605352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.605864 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.900127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.910114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.912131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.913546 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b8fb25f8-edda-46a5-9b4a-1e8b5d39f793 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.323739 Feb 17 04:40:20.914597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 419/852] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:20 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:21.935687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:21.936640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:21.949350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.950401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.951343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.951973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.204387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.216852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.218611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.219911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-467eaddf-7237-4053-bc2c-6fefc0cc6fcc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.289541 Feb 17 04:40:22.220706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 434/853] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:21 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:23.240544 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:23.241666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:23.253351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.253874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.255317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.255829 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.574876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:23.586427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:23.589166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:23.590950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-405887ca-350c-409e-9f16-13bdbdf9b6cd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.355277 Feb 17 04:40:23.591583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 420/854] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:23 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:24.612454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:24.613044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:24.622103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.622103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.622898 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.623423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.867156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:24.879075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:24.880804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:24.882073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2ba56989-e403-492e-b596-4e55aead9533 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.273722 Feb 17 04:40:24.882686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 435/855] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:24 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:25.906946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:25.907654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:25.916933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:25.917370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:25.918244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:25.918746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.144937 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.154342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.155941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.157130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6c9dd0fb-accc-46f7-b2b5-c09168c93dad tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1740 microversion: 2.20 time: 0.254636 Feb 17 04:40:26.157712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 421/856] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:25 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:27.177172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:27.177882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:27.186762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.187274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.188167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.188737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.659030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:27.660700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:27.668713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:27.670560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.671511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.672589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.674025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.679511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:27.681139 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:27.682381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0942f582-aab0-41aa-873c-07469e78ac82 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1722 microversion: 2.20 time: 0.509490 Feb 17 04:40:27.683000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 436/857] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:27 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:27.761522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fb65134f-433b-4b83-a1e7-82f7863bfe37 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.106641 Feb 17 04:40:27.762157 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 422/858] 10.222.0.73 () {58 vars in 1292 bytes} [Wed Feb 17 04:40:27 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:28.008897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:28.009369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:28.017837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.018346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.019205 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.019802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.092042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c0a414d5-5dbc-4b89-9ddd-f4ff59938b4b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/fa3ea68c-7d21-413c-bba1-fe4a301b0b88" status: 200 len: 194 microversion: 2.1 time: 0.087805 Feb 17 04:40:28.092721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 437/859] 10.222.0.73 () {58 vars in 1403 bytes} [Wed Feb 17 04:40:28 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/fa3ea68c-7d21-413c-bba1-fe4a301b0b88 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:28.104060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:28.104613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:28.112803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.113311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.114760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.115257 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.293983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lazy-loading 'services' on Instance uuid 35ae0bfb-e255-47a6-bf27-52b718f80175 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:28.524624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4423767a-2570-405d-a1df-39594967a7a3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/fa3ea68c-7d21-413c-bba1-fe4a301b0b88" status: 202 len: 0 microversion: 2.1 time: 0.424251 Feb 17 04:40:28.529090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 423/860] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:40:28 2021] DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/fa3ea68c-7d21-413c-bba1-fe4a301b0b88 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:28.704749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:28.705780 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:28.718366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.718878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.719866 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.720338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.950846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.961560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.963227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.964481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0d29c052-2175-4959-911b-7df0f3247404 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1722 microversion: 2.20 time: 0.265691 Feb 17 04:40:28.965087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 438/861] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:28 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:29.985748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:29.986426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.994818 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.995358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.996206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.996711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.429641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:30.439112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:30.440720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:30.442472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cea6a8ca-92d1-4269-a1c7-aaf2da61ea60 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1725 microversion: 2.20 time: 0.461030 Feb 17 04:40:30.443042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 424/862] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:29 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1725 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:30.462074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee227880-b1a8-48a4-a9cf-b33a780f8c01"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:30.463418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:30.471615 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.472216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.473141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.473722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.632832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-e5bb9623-6a4c-4b10-83ac-0350f709e9fd req-e8ab364f-57b6-4c7e-862f-559d78bc91d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "name": "network-vif-unplugged", "status": "completed", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:30.634426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:30.634426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:40:30.654516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-e5bb9623-6a4c-4b10-83ac-0350f709e9fd req-e8ab364f-57b6-4c7e-862f-559d78bc91d3 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.655020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-e5bb9623-6a4c-4b10-83ac-0350f709e9fd req-e8ab364f-57b6-4c7e-862f-559d78bc91d3 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.679113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.compute.server_external_events [req-e5bb9623-6a4c-4b10-83ac-0350f709e9fd req-e8ab364f-57b6-4c7e-862f-559d78bc91d3 service nova] Unable to find a host for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9. Dropping event network-vif-unplugged {{(pid=98221) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 04:40:30.680216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-e5bb9623-6a4c-4b10-83ac-0350f709e9fd req-e8ab364f-57b6-4c7e-862f-559d78bc91d3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052475 Feb 17 04:40:30.680968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 425/863] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 04:40:31.356683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:31.357287 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:31.365218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.365902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.366893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.367424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.440345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3be0d0af-15d0-4dec-8546-3e165adec8aa tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/772d52c6-3659-4a8f-aa00-131b97afebb5" status: 200 len: 194 microversion: 2.1 time: 0.087681 Feb 17 04:40:31.441019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 426/864] 10.222.0.73 () {58 vars in 1403 bytes} [Wed Feb 17 04:40:31 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/772d52c6-3659-4a8f-aa00-131b97afebb5 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:31.451721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:31.452271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:31.460882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.461388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.462244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.462732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.640916 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lazy-loading 'services' on Instance uuid 35ae0bfb-e255-47a6-bf27-52b718f80175 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:31.670925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d9995948-a0a1-4b7c-84f4-8c477e576508 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.213491 Feb 17 04:40:31.671645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 439/865] 10.222.0.73 () {62 vars in 1354 bytes} [Wed Feb 17 04:40:30 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/os-volume_attachments => generated 188 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:40:31.785950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:31.786748 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:31.794955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.795495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.796384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.796874 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.831115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-95e5a051-f841-4afc-b40e-9597764c7f30 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/772d52c6-3659-4a8f-aa00-131b97afebb5" status: 202 len: 0 microversion: 2.1 time: 0.383232 Feb 17 04:40:31.832021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 427/866] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:40:31 2021] DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175/os-volume_attachments/772d52c6-3659-4a8f-aa00-131b97afebb5 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:40:32.567847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3d832e0b-ce92-451e-b062-3940bb85762f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/os-volume_attachments/ee227880-b1a8-48a4-a9cf-b33a780f8c01" status: 202 len: 0 microversion: 2.20 time: 0.785980 Feb 17 04:40:32.568714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 440/867] 10.222.0.73 () {60 vars in 1447 bytes} [Wed Feb 17 04:40:31 2021] DELETE /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/os-volume_attachments/ee227880-b1a8-48a4-a9cf-b33a780f8c01 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:33.039767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:33.040509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:33.052510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.056365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.056365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.056365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.343714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f1928d13-7345-41de-8d50-b98b71b124d5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action" status: 202 len: 0 microversion: 2.20 time: 0.310497 Feb 17 04:40:33.344557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 428/868] 10.222.0.73 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:33 2021] POST /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:33.352943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:33.353770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:33.361889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.362408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.363267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.363853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.549926 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:33.550485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:33.559042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.559624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.560622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.561114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.627338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:33.628784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:33.638142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:33.639731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:33.640923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-602a14eb-c605-45c5-8e0e-ab38e4a75414 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1673 microversion: 2.20 time: 0.292074 Feb 17 04:40:33.653185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 441/869] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:33 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:33.831925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c4219f05-682e-4784-a82e-d5b2f2785949 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 204 len: 0 microversion: 2.1 time: 0.285496 Feb 17 04:40:33.832758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 429/870] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:33 2021] DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:40:33.841456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:33.842125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:33.850130 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.850635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.851498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.851990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.106435 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:34.116034 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-dcf68bbc-dcac-4bdc-a09b-66be0206e7f3 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1673 microversion: 2.1 time: 0.278610 Feb 17 04:40:34.116660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 442/871] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:33 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1673 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:34.661618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:34.662395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:34.674538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.675053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.675930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.676422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.036137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.046488 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.048105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.049404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0efcf47b-0998-4888-be0d-a4dbdb5acf00 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1675 microversion: 2.20 time: 0.392526 Feb 17 04:40:35.055581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 430/872] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:34 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1675 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:35.135433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:35.136105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:35.144444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:35.144958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.145806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:35.146659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.366871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.376154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-27543372-1cb8-4b06-9640-99196b36d950 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1673 microversion: 2.1 time: 0.245477 Feb 17 04:40:35.376814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 443/873] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:35 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:36.076707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:36.077409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:36.089234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.089749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.091008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.093988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.394296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:36.399391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:36.404222 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.405552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.406661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.407416 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.683842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:36.702445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:36.709712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:36.713462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c08ee303-f71b-4800-ad51-dc76d6394f26 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.639559 Feb 17 04:40:36.715482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 431/874] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:36 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:36.763324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-7edc238c-7b94-40a3-9e7e-6774780fef07 req-2bbbc205-3c07-4f1e-bea7-72ab2d5cb939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ae0bfb-e255-47a6-bf27-52b718f80175", "name": "network-vif-unplugged", "status": "completed", "tag": "6249f6fb-e214-4e01-88cf-00d6399056e8"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:36.765400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:36.765400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:40:36.779424 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-7edc238c-7b94-40a3-9e7e-6774780fef07 req-2bbbc205-3c07-4f1e-bea7-72ab2d5cb939 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.779942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-7edc238c-7b94-40a3-9e7e-6774780fef07 req-2bbbc205-3c07-4f1e-bea7-72ab2d5cb939 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.842800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-7edc238c-7b94-40a3-9e7e-6774780fef07 req-2bbbc205-3c07-4f1e-bea7-72ab2d5cb939 service nova] Creating event network-vif-unplugged:6249f6fb-e214-4e01-88cf-00d6399056e8 for instance 35ae0bfb-e255-47a6-bf27-52b718f80175 on hv-cinder-75995 Feb 17 04:40:36.861902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-7edc238c-7b94-40a3-9e7e-6774780fef07 req-2bbbc205-3c07-4f1e-bea7-72ab2d5cb939 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101959 Feb 17 04:40:36.863985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 432/875] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:37.086736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:37.101192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1877cc6c-8546-4d1f-8314-ea771f1464c5 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1673 microversion: 2.1 time: 0.710877 Feb 17 04:40:37.107663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 444/876] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:36 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1673 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:37.735227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:37.741920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:37.754754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.763954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.765418 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.766008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.120775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:38.122029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:38.131157 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.131790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.132663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.133196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.376886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.399940 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.401569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.402801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e8a0f594-faee-46bc-bcd7-7c824e480fe7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.672157 Feb 17 04:40:38.403432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 433/877] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:37 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:38.440746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.451479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5c429793-a43b-49b9-a1d8-a660e2e5597c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1673 microversion: 2.1 time: 0.334626 Feb 17 04:40:38.452110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 445/878] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:38 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1673 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:39.423035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:39.424639 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:39.435720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.436560 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.437820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.438464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.470996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:39.471820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:39.493902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.499306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.504233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.504840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.726220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:39.749252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9f062031-ee25-45aa-a592-05fff5196da2 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.281220 Feb 17 04:40:39.750994 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 446/879] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:39 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:39.801197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b9e1a5e9-b288-486d-991b-377506dbc5cc req-6f66798f-e261-4307-ab88-477027176ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ae0bfb-e255-47a6-bf27-52b718f80175", "name": "network-vif-deleted", "tag": "6249f6fb-e214-4e01-88cf-00d6399056e8"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:39.803441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:39.803441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:40:39.825990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b9e1a5e9-b288-486d-991b-377506dbc5cc req-6f66798f-e261-4307-ab88-477027176ee9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.826547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b9e1a5e9-b288-486d-991b-377506dbc5cc req-6f66798f-e261-4307-ab88-477027176ee9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.882826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b9e1a5e9-b288-486d-991b-377506dbc5cc req-6f66798f-e261-4307-ab88-477027176ee9 service nova] Creating event network-vif-deleted:6249f6fb-e214-4e01-88cf-00d6399056e8 for instance 35ae0bfb-e255-47a6-bf27-52b718f80175 on hv-cinder-75995 Feb 17 04:40:39.898460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b9e1a5e9-b288-486d-991b-377506dbc5cc req-6f66798f-e261-4307-ab88-477027176ee9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101313 Feb 17 04:40:39.899433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 447/880] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:39.958033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:39.968413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:39.970674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:39.972863 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-69c927cf-edf8-46f0-b3b7-3f38e10631bc tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.554069 Feb 17 04:40:39.973894 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 434/881] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:39 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:40.770469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:40.771249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:40.785768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:40.787046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:40.788015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:40.788523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:40.924915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:40.936712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d36aef25-ea78-4528-9cfd-55257d8b2e2e tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.170387 Feb 17 04:40:40.937396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 448/882] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:40 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:40.992518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:40.993195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:41.003127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.003673 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.004549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.005050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.237095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:41.247384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:41.249049 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:41.250268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7f01ee4f-bf4a-44a5-bae9-6754326a3e50 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.262644 Feb 17 04:40:41.250871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 435/883] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:40 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:41.955709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:41.956382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:41.964338 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.964843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.965678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.966184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.144239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.156010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-030b96bb-1b92-4ffb-bd68-31140e71452b tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.204374 Feb 17 04:40:42.174634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 449/884] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:41 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:42.270258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:42.271663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.279743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.280253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.281123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.281621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.508397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.519047 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.520697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.521998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d3c854f5-9c7a-44dc-8704-b8f81a149ced tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.256116 Feb 17 04:40:42.522567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 436/885] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:42 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:43.176026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:43.176706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:43.185552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.186074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.186934 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.187466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.335563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:43.358677 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-170e5d02-60b4-4d62-aa39-7387880f8eff tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.185563 Feb 17 04:40:43.359879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 450/886] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:43 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:43.551645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:43.552353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:43.560188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.560695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.561534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.562024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.802135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:43.813913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:43.813913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:43.816024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1704e15d-1e8d-4f72-9483-c4640bc53eec tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.267616 Feb 17 04:40:43.830552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 437/887] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:43 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:44.378465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:44.380112 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:44.388841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.389778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.390932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.391552 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.526218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:44.535670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f6f8432a-d1f7-4e81-89c7-0cb115f63503 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.161396 Feb 17 04:40:44.537046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 451/888] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:44 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:44.837554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:44.838255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:44.846779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.847687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.848853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.850060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.081567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:45.097788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:45.099936 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:45.101145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-07c99548-5d57-48c3-8af3-a120970070dd tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.268144 Feb 17 04:40:45.101766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 438/889] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:44 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:45.560109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:45.560769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:45.568812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.569311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.570155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.570656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.710215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:45.719350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-646de773-3025-4e08-a1bf-c43112a6021c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.163352 Feb 17 04:40:45.720297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 452/890] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:45 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:46.120816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:46.121482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:46.129450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.129954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.131359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.131849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.378369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.392115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.394292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.395857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cbcef80c-a35a-41e5-aaca-fef2d99eeb9a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.279196 Feb 17 04:40:46.396460 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 439/891] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:46 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:46.738086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:46.738775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:46.747035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.747592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.748451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.749012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.876364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.885950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-bf78412f-6e2e-4628-b387-c93a2390fe89 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1606 microversion: 2.1 time: 0.151810 Feb 17 04:40:46.886601 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 453/892] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:46 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1606 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:47.416542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:47.417250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:47.425436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.426046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.426967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.428113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.658235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:47.669228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:47.672087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:47.674000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3d2fe983-0b14-48ae-bd69-e10ae1be83df tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.262194 Feb 17 04:40:47.675064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 440/893] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:47 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:47.905083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:47.905929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:47.914638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.915141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.916056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.916551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.993303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.993303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.993303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lazy-loading 'fault' on Instance uuid 35ae0bfb-e255-47a6-bf27-52b718f80175 {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:48.063206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46934d3d2dd4c129cc4359c322854e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ceefaf95d6747d4874041041d75b0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:48.073293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-81c8b4f2-c8b3-4443-a38c-8a9232ae023c tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 200 len: 1327 microversion: 2.1 time: 0.171899 Feb 17 04:40:48.079741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 454/894] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:47 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:48.696044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:48.696732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:48.704867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.705380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.706232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.706731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.926341 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:48.936015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:48.937620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:48.938861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-90e76e90-90ec-44eb-95e5-a39781d1fb36 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.247033 Feb 17 04:40:48.939479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 441/895] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:48 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:49.093409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.094111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.103433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.104242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.105091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.106118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.164267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] HTTP exception thrown: Instance 35ae0bfb-e255-47a6-bf27-52b718f80175 could not be found. Feb 17 04:40:49.165214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Returning 404 to user: Instance 35ae0bfb-e255-47a6-bf27-52b718f80175 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:49.166147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-95a75730-9e9c-49ca-a3c2-5da51277a62d tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 404 len: 111 microversion: 2.1 time: 0.077316 Feb 17 04:40:49.166737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 455/896] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:49 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:49.176122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-599e392c-7bbe-4fe0-911e-e41f25a6494f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '.version_select at 0x7f9b2feb29d8>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.219970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b3267294-6a7f-4071-90a6-e290c421695f req-2a559de1-1c44-4502-b990-ea684e7d926b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "name": "network-vif-plugged", "status": "completed", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:49.221819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:49.221819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:40:49.232153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b3267294-6a7f-4071-90a6-e290c421695f req-2a559de1-1c44-4502-b990-ea684e7d926b service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.232595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b3267294-6a7f-4071-90a6-e290c421695f req-2a559de1-1c44-4502-b990-ea684e7d926b service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.233251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-599e392c-7bbe-4fe0-911e-e41f25a6494f tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194524392" status: 202 len: 0 microversion: 2.1 time: 0.061407 Feb 17 04:40:49.233887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 442/897] 10.222.0.73 () {58 vars in 1211 bytes} [Wed Feb 17 04:40:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194524392 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:49.252753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b3267294-6a7f-4071-90a6-e290c421695f req-2a559de1-1c44-4502-b990-ea684e7d926b service nova] Creating event network-vif-plugged:9f18046e-e3e6-4296-a693-3a238c8173b1 for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 on hv-cinder-75995 Feb 17 04:40:49.259094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b3267294-6a7f-4071-90a6-e290c421695f req-2a559de1-1c44-4502-b990-ea684e7d926b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043095 Feb 17 04:40:49.259971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 456/898] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:49.958848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.960188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.968957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.969439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.970444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.971085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.380643 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:50.391400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:50.393225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:50.394652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-690b4ec3-074c-4f00-8931-dcb093e20574 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.440507 Feb 17 04:40:50.395470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 443/899] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:49 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:51.415504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:51.416290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:51.425297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.425789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.426633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.427323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.668134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:51.679662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:51.681929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:51.683555 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8244bba6-fcc9-4270-9648-047c19cbbb42 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.273160 Feb 17 04:40:51.684311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 457/900] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:51 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:52.704051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:52.704713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:52.717939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:52.718522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:52.723565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.724113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.724983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.725482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.727861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.734752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.734752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.734752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.792413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lazy-loading 'flavor' on Instance uuid d78384a9-70f3-4b71-afd3-75be242a9c9e {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:52.967684 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:52.978135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:52.979858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:52.984739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5ad8da03-55a1-499b-a085-2c12869fca55 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1731 microversion: 2.20 time: 0.281325 Feb 17 04:40:52.984739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 444/901] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:52 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:53.183522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-71482ed1-75d8-4ce8-be58-b3c164878a62 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.466558 Feb 17 04:40:53.183522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 458/902] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:52 2021] POST /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:53.190812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.191572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.200800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.201635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.202493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.203186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.419115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:53.429160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a410443e-e88b-4ffc-bbf0-8a503337727d tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.242786 Feb 17 04:40:53.429767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 445/903] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:53.781127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.781788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.790819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.791365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.792217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.792720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.845737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] HTTP exception thrown: Instance 35ae0bfb-e255-47a6-bf27-52b718f80175 could not be found. Feb 17 04:40:53.846410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Returning 404 to user: Instance 35ae0bfb-e255-47a6-bf27-52b718f80175 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:53.847349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a29b56c2-60fe-45f6-af00-663425632994 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 404 len: 111 microversion: 2.1 time: 0.070877 Feb 17 04:40:53.847973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 459/904] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:53 2021] DELETE /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:53.857142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.857822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: 35ae0bfb-e255-47a6-bf27-52b718f80175] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.865845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.866368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.867638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.868149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.921156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] HTTP exception thrown: Instance 35ae0bfb-e255-47a6-bf27-52b718f80175 could not be found. Feb 17 04:40:53.921824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Returning 404 to user: Instance 35ae0bfb-e255-47a6-bf27-52b718f80175 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:53.922738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-42283d76-75d5-4770-8e1d-e02865a20b40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175" status: 404 len: 111 microversion: 2.1 time: 0.069619 Feb 17 04:40:53.923383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 446/905] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/35ae0bfb-e255-47a6-bf27-52b718f80175 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:54.001281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:54.001948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:54.009839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.010352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.011191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.011745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.235121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.245109 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.246697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.247940 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-64d6553f-2055-456a-a161-8a1817a35e2d tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1718 microversion: 2.20 time: 0.250732 Feb 17 04:40:54.248532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 460/906] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1718 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:54.449423 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:54.450128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:54.458033 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.458548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.459421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.459949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.687875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.697471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4ee1a692-dd26-45d0-a244-853a2d5840b6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.252229 Feb 17 04:40:54.698061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 447/907] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:54 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:55.261676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:55.262232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.270974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.271563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.272432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.272930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.331110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] HTTP exception thrown: Instance fe67c43f-82ea-4944-a563-9fed39d42080 could not be found. Feb 17 04:40:55.331822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Returning 404 to user: Instance fe67c43f-82ea-4944-a563-9fed39d42080 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:55.332746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f5b2947a-6d4c-48d1-ab54-437abf882c40 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 404 len: 111 microversion: 2.1 time: 0.075107 Feb 17 04:40:55.333953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 461/908] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:55 2021] DELETE /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:55.342669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:55.343356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] [instance: fe67c43f-82ea-4944-a563-9fed39d42080] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.351457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.351971 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.352815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.353304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.408002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] HTTP exception thrown: Instance fe67c43f-82ea-4944-a563-9fed39d42080 could not be found. Feb 17 04:40:55.408674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] Returning 404 to user: Instance fe67c43f-82ea-4944-a563-9fed39d42080 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:55.409588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b37ff8be-8d6f-4692-8034-9f19d5fc2749 tempest-AttachVolumeTestJSON-1346891063 tempest-AttachVolumeTestJSON-1346891063-project] 10.222.0.73 "GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080" status: 404 len: 111 microversion: 2.1 time: 0.070996 Feb 17 04:40:55.410208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 448/909] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:55 2021] GET /compute/v2.1/servers/fe67c43f-82ea-4944-a563-9fed39d42080 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:55.716547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:55.717273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.725242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.725772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.726619 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.727117 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:56.404110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:56.416008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a852cd1d-22a4-45ea-9340-9329de17ec29 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.703118 Feb 17 04:40:56.416321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 462/910] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:55 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:57.435805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:57.436811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:57.446204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.446766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.447759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.448144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.678561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:57.688436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2b3dcd8f-2986-497c-82ae-e0dfd9e9d573 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.256626 Feb 17 04:40:57.690179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 449/911] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:57 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:58.708617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:58.709288 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:58.717369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.717879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.718724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.719210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.508515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:59.518029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-568a54d1-668d-4a60-9f87-a9fbd44221f7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.814035 Feb 17 04:40:59.518654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 463/912] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:58 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:00.536783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:00.537631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:00.545379 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.545896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.546731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.547220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.782345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:00.792399 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d92641d5-7648-471e-bf83-63bb9960d6d2 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.260226 Feb 17 04:41:00.793152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 450/913] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:00 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:01.812113 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:01.813607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:01.823448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.824095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.825706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.826293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:02.366623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:02.376266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-80fc3121-f6e9-492b-bdb1-85162d76a898 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.568147 Feb 17 04:41:02.376895 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 464/914] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:01 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:03.396775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:03.397547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:03.405580 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.406105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.406966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.407499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.647648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:03.657307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-541ad5fd-d0ff-4893-9307-0434a3114ff7 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.265416 Feb 17 04:41:03.657802 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 451/915] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:03 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:04.676354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:04.677657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:04.686272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:04.686772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:04.687659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:04.688155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:04.937609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:04.950812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-776425f1-532f-449f-95ea-9b954503d974 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.278345 Feb 17 04:41:04.951467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 465/916] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:04 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:05.977436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:05.978319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:05.986586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:05.987229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:05.988116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:05.988578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.225722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:06.243066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b1992d69-2309-40df-b0c0-278930d5aa28 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.270013 Feb 17 04:41:06.244232 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 452/917] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:05 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:41:07.270841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:07.271467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:07.279972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:07.280725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:07.281618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:07.282145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:07.553169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:07.565054 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c00677c3-a22a-42b0-b334-1178c3f2047f tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1571 microversion: 2.1 time: 0.298378 Feb 17 04:41:07.565800 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 466/918] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:07 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1571 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:08.258659 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-ca87a504-8090-4f40-9105-b5ad9ba1dca2 req-5ff1b618-fbd0-4060-85f2-1e65ee2a5258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "name": "network-vif-unplugged", "status": "completed", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:08.261384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:08.261384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:08.270973 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-ca87a504-8090-4f40-9105-b5ad9ba1dca2 req-5ff1b618-fbd0-4060-85f2-1e65ee2a5258 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.271515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-ca87a504-8090-4f40-9105-b5ad9ba1dca2 req-5ff1b618-fbd0-4060-85f2-1e65ee2a5258 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.295017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-ca87a504-8090-4f40-9105-b5ad9ba1dca2 req-5ff1b618-fbd0-4060-85f2-1e65ee2a5258 service nova] Creating event network-vif-unplugged:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:41:08.302220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-ca87a504-8090-4f40-9105-b5ad9ba1dca2 req-5ff1b618-fbd0-4060-85f2-1e65ee2a5258 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048230 Feb 17 04:41:08.302933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 453/919] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:41:08.583453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:08.584127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:08.592604 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.593111 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.594177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.594724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.906125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:08.916983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e5edd991-f957-4a12-82ec-2894653c13b5 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1572 microversion: 2.1 time: 0.337396 Feb 17 04:41:08.917701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 467/920] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:08 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1572 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:08.960587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:08.961952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:08.989501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.991171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.993876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.994867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.321747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ca3a1138-f8f6-474c-bfc6-7404140f5446 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "POST /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.381400 Feb 17 04:41:09.322778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 454/921] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:41:08 2021] POST /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:09.331583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:09.332714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:09.341897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.342375 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.343434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.344076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.626103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:09.636727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8adad471-ecaa-4cf0-9abf-116bf366d8fa tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1520 microversion: 2.1 time: 0.309617 Feb 17 04:41:09.637366 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 468/922] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:09 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:10.660198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:10.661253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:10.675261 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:10.676052 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:10.678184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:10.679228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:10.926276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:10.936299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a6cab88f-3d38-44d3-a7dc-612bf11f62bc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1522 microversion: 2.1 time: 0.283554 Feb 17 04:41:10.936912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 455/923] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:10 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:11.956960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:11.958404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:11.967967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:11.969218 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:11.970349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:11.971142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:12.292180 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:12.302711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-11047910-9498-4165-adf1-58fe17db4ba8 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1522 microversion: 2.1 time: 0.350151 Feb 17 04:41:12.303227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 469/924] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:11 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:41:13.324474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:13.325234 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:13.335917 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:13.336631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:13.337929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:13.338644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:13.567896 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:13.577607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a80afccc-6e0d-4a2f-a124-5b2944daa028 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.258584 Feb 17 04:41:13.578197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 456/925] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:13 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:14.602550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:14.604381 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:14.614361 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:14.614870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:14.615819 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:14.616316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:15.029055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:15.039064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c00b4797-dde8-498a-9f2f-d6b1c139e069 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.443430 Feb 17 04:41:15.039739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 470/926] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:14 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:16.058477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:16.059163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:16.067844 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:16.068282 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:16.069149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:16.069657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:16.305805 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:16.315661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-646c028d-17e9-4afb-8e80-f14adb625189 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.260650 Feb 17 04:41:16.316553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 457/927] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:16 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:41:17.335128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:17.335956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:17.344067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:17.344583 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:17.345429 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:17.345923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:17.578715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:17.588548 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-89da30c4-a8e5-4366-b279-8a1670e32b0c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.257951 Feb 17 04:41:17.589162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 471/928] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:17 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:18.606733 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:18.607722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:18.617537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:18.618211 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:18.619182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:18.619797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:18.847854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:18.857496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ea6beac7-f578-40ae-87b0-8a1201cf51d0 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.254874 Feb 17 04:41:18.858129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 458/929] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:18 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:19.876412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:19.877132 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:19.885510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:19.886012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:19.886878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:19.900704 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:20.127523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:20.137902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d1ef961a-698e-4d7e-baa8-42f20bafed71 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.265468 Feb 17 04:41:20.138536 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 472/930] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:19 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:20.921745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-08ca9d39-e1a4-4a3f-bedc-d3d1a54ffad5 req-d372ca77-5064-45e1-8973-4b5e831ba645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "name": "network-vif-plugged", "status": "completed", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:20.924044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:20.924044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:20.937283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-08ca9d39-e1a4-4a3f-bedc-d3d1a54ffad5 req-d372ca77-5064-45e1-8973-4b5e831ba645 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:20.937283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-08ca9d39-e1a4-4a3f-bedc-d3d1a54ffad5 req-d372ca77-5064-45e1-8973-4b5e831ba645 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:20.953533 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-08ca9d39-e1a4-4a3f-bedc-d3d1a54ffad5 req-d372ca77-5064-45e1-8973-4b5e831ba645 service nova] Creating event network-vif-plugged:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:41:20.960335 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-08ca9d39-e1a4-4a3f-bedc-d3d1a54ffad5 req-d372ca77-5064-45e1-8973-4b5e831ba645 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042361 Feb 17 04:41:20.960977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 459/931] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:21.157770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:21.158846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:21.168265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:21.168860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:21.169707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:21.170235 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:21.515594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:21.531037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-eda9f2d1-e6f5-4063-9119-84a23642b757 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.376210 Feb 17 04:41:21.531037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 473/932] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:21 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:22.549164 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:22.549997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:22.559924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:22.560663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:22.561513 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:22.562004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:22.802899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:22.812363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a365db03-d876-4844-ba2b-f79c93de3662 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1578 microversion: 2.1 time: 0.267686 Feb 17 04:41:22.812962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 460/933] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:22 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:23.832569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:23.833252 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:23.841809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:23.844404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:23.845542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:23.846409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.076152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:24.085754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e16bbeeb-828a-48d9-b1ba-0458858f5f69 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1565 microversion: 2.1 time: 0.257163 Feb 17 04:41:24.086434 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 474/934] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:23 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1565 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:25.740356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:25.740901 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:25.749911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:25.750539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:25.751523 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:25.752114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:25.825290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:26.088626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-308fe2d2-a927-4565-89d0-22995b826876 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 204 len: 0 microversion: 2.20 time: 0.352070 Feb 17 04:41:26.089214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 461/935] 10.222.0.73 () {60 vars in 1270 bytes} [Wed Feb 17 04:41:25 2021] DELETE /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:41:26.098485 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:26.105195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:26.107711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:26.108226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:26.109067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:26.109572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:26.335799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.345779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.347329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.348766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c7748f6a-5a86-4b47-b275-62a52a5ccd27 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.254805 Feb 17 04:41:26.353395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 475/936] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:26 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:27.373534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:27.374309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:27.382589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.383102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.383990 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.384499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.612304 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.622265 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.623993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.625152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f8517725-adc5-4730-a0db-360e9c3921f7 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.256439 Feb 17 04:41:27.625761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 462/937] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:27 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:28.293867 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1843110535", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "03e92244-b0e1-440a-bd01-1b65157a154e"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:28.361912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] validate_networks() for [('03e92244-b0e1-440a-bd01-1b65157a154e', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:41:28.393186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-0d0950dd-5d77-42f8-bcba-a5219dbad656 req-28f73a78-ec52-4986-a292-003d9f2fa9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "name": "network-vif-unplugged", "status": "completed", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:28.394854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:28.394854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:28.404974 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0d0950dd-5d77-42f8-bcba-a5219dbad656 req-28f73a78-ec52-4986-a292-003d9f2fa9e3 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.416988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0d0950dd-5d77-42f8-bcba-a5219dbad656 req-28f73a78-ec52-4986-a292-003d9f2fa9e3 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.425281 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-0d0950dd-5d77-42f8-bcba-a5219dbad656 req-28f73a78-ec52-4986-a292-003d9f2fa9e3 service nova] Creating event network-vif-unplugged:9f18046e-e3e6-4296-a693-3a238c8173b1 for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 on hv-cinder-75995 Feb 17 04:41:28.431088 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-0d0950dd-5d77-42f8-bcba-a5219dbad656 req-28f73a78-ec52-4986-a292-003d9f2fa9e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042263 Feb 17 04:41:28.431770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 463/938] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:41:28.646371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:28.647846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:28.657014 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.657638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.658598 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.659197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.882575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:28.892225 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:28.893821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:28.895028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6e34c62a-4d41-458d-abac-9713cbd06f22 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.253563 Feb 17 04:41:28.895701 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 464/939] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:28 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:29.107620 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:41:29.108095 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:41:29.108638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:41:29.109096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:41:29.109558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:41:29.118532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:29.119032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:29.119936 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:29.120431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:29.139364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Getting quotas for project d222969e9f8c4c679e15b8cafb6e2f9d. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:41:29.143617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Getting quotas for user 2be87370014d4ff390aa0b2bb2b01d48 and project d222969e9f8c4c679e15b8cafb6e2f9d. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:41:29.155699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:41:29.158243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:41:29.239985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-aa552dbf-5474-49a6-8de4-0bee77cecf0d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950016 Feb 17 04:41:29.240749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 476/940] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:41:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:41:29.252053 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8be784ba-2e4a-4e4f-8cda-117a4ede7687 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:29.252747 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8be784ba-2e4a-4e4f-8cda-117a4ede7687 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:29.342231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8be784ba-2e4a-4e4f-8cda-117a4ede7687 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:29.347303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8be784ba-2e4a-4e4f-8cda-117a4ede7687 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1219 microversion: 2.1 time: 0.099453 Feb 17 04:41:29.348028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 465/941] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:29 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:29.916149 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:29.917537 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:29.926556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:29.927373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:29.929114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:29.929586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:30.265271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:30.277721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:30.279876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:30.281880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2ccf4014-c5e8-4639-afe9-361067a9c2c1 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1724 microversion: 2.20 time: 0.370777 Feb 17 04:41:30.281880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 477/942] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:29 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:30.366233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:30.367383 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:30.388066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:30.388582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:30.389456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:30.389931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:30.530091 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:30.549595 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4d39e9e0-6dcc-45a8-909f-8ceb1680e79c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1215 microversion: 2.1 time: 0.187284 Feb 17 04:41:30.555057 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 466/943] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:30 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:31.302371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:31.303758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:31.314987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:31.315912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:31.316785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:31.317289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:31.419530 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b069233e-48ce-45ec-a409-b9b7cda8e29e req-1c942bbf-1808-4e6f-8374-52adbb195903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7295bd05-b3ff-4dc9-915b-8c869f6f68f9", "name": "network-vif-deleted", "tag": "9f18046e-e3e6-4296-a693-3a238c8173b1"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:31.421210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:31.421210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:31.439920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b069233e-48ce-45ec-a409-b9b7cda8e29e req-1c942bbf-1808-4e6f-8374-52adbb195903 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:31.440515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b069233e-48ce-45ec-a409-b9b7cda8e29e req-1c942bbf-1808-4e6f-8374-52adbb195903 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:31.501910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b069233e-48ce-45ec-a409-b9b7cda8e29e req-1c942bbf-1808-4e6f-8374-52adbb195903 service nova] Creating event network-vif-deleted:9f18046e-e3e6-4296-a693-3a238c8173b1 for instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 on hv-cinder-75995 Feb 17 04:41:31.507744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b069233e-48ce-45ec-a409-b9b7cda8e29e req-1c942bbf-1808-4e6f-8374-52adbb195903 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092516 Feb 17 04:41:31.509410 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 467/944] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:31.571195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:31.572321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:31.580767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:31.581278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:31.582402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:31.583031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:31.598910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.620933 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.622761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd048d5803b14ad2b23a35d8f288002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4db349eea3a41deb61c89e67a673600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.624292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e56f6b1f-0190-4a45-96a6-a5e1ed79fa7a tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 200 len: 1657 microversion: 2.20 time: 0.325908 Feb 17 04:41:31.625386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 478/945] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:31 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 1657 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:31.975666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.993975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-49f9548f-dfc0-448e-8308-8ff95386ccc8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1279 microversion: 2.1 time: 0.419653 Feb 17 04:41:31.993975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 468/946] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:31 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1279 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:41:32.648178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:32.649617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:32.667026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:32.667840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:32.680725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:32.681840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:32.754732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] HTTP exception thrown: Instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 could not be found. Feb 17 04:41:32.755617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Returning 404 to user: Instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:32.756661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fe872f3c-639d-43f9-ab35-38fad8b9c05f tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 404 len: 111 microversion: 2.20 time: 0.114056 Feb 17 04:41:32.759751 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 479/947] 10.222.0.73 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:32 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:41:32.766824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-15571ecd-72f4-487c-a7cd-5465604bb091 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '.version_select at 0x7f9b2fe39510>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:32.882324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-15571ecd-72f4-487c-a7cd-5465604bb091 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447289100" status: 204 len: 0 microversion: 2.20 time: 0.119692 Feb 17 04:41:32.883101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 469/948] 10.222.0.73 () {60 vars in 1252 bytes} [Wed Feb 17 04:41:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447289100 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:41:33.020065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:33.020783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:33.040600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:33.041103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:33.041963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:33.042456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:33.351001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:33.362184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3c753e50-32d7-49a0-8d7e-d7f3b8e95f51 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.355820 Feb 17 04:41:33.363057 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 480/949] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:33 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:34.387676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:34.388368 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:34.397449 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:34.397969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:34.398885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:34.399415 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:35.228843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:35.238294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-27ce58b4-eb33-4a51-8240-3817badb6090 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.854700 Feb 17 04:41:35.239198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 470/950] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:34 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:36.258531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:36.259210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:36.269696 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.270616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.271557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.272557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.373363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-aeb4f124-167e-4db6-b5c7-ca3672f0faaf req-c73e80b1-8d88-447c-bdcb-c432c9c4b4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e", "tag": "e805da08-d0ad-4991-991c-1ff856e5f049"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:36.376272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:36.376272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:36.384749 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-aeb4f124-167e-4db6-b5c7-ca3672f0faaf req-c73e80b1-8d88-447c-bdcb-c432c9c4b4b1 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.385503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-aeb4f124-167e-4db6-b5c7-ca3672f0faaf req-c73e80b1-8d88-447c-bdcb-c432c9c4b4b1 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.405849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-aeb4f124-167e-4db6-b5c7-ca3672f0faaf req-c73e80b1-8d88-447c-bdcb-c432c9c4b4b1 service nova] Creating event network-changed:e805da08-d0ad-4991-991c-1ff856e5f049 for instance c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e on hv-cinder-75995 Feb 17 04:41:36.415945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-aeb4f124-167e-4db6-b5c7-ca3672f0faaf req-c73e80b1-8d88-447c-bdcb-c432c9c4b4b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048966 Feb 17 04:41:36.417012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 471/951] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:36.560496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:36.571777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-03fa99eb-7389-4048-8921-df5617ebd71b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.317591 Feb 17 04:41:36.573663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 481/952] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:36 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:37.590828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:37.591534 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:37.600559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.601066 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.602074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.602487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.868382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:37.868940 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:37.892870 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.893350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.894364 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.895060 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.974476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.977837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] HTTP exception thrown: Instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 could not be found. Feb 17 04:41:37.978516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Returning 404 to user: Instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:37.979448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-92d2fd7a-d7ee-4ae3-b8d8-d01bc1f17149 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 404 len: 111 microversion: 2.1 time: 0.115538 Feb 17 04:41:37.980371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 482/953] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:37 2021] DELETE /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:37.986453 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2ea8b423-1be4-4ea6-b86e-259cf5c942fb tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.400158 Feb 17 04:41:37.987821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 472/954] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:37 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:37.993846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:37.994515 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: 7295bd05-b3ff-4dc9-915b-8c869f6f68f9] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:38.004202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:38.004795 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:38.005794 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:38.006912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:38.079714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] HTTP exception thrown: Instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 could not be found. Feb 17 04:41:38.080783 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Returning 404 to user: Instance 7295bd05-b3ff-4dc9-915b-8c869f6f68f9 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:38.081700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a47ab61c-403e-48a5-bac6-ff0bcf4a4da5 tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9" status: 404 len: 111 microversion: 2.1 time: 0.096629 Feb 17 04:41:38.082585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 483/955] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:37 2021] GET /compute/v2.1/servers/7295bd05-b3ff-4dc9-915b-8c869f6f68f9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:39.006427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:39.007221 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:39.015495 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.016106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.017032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.017607 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.249579 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:39.259267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fc5d2383-a22c-403a-b16b-5e73a8b937be tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.256881 Feb 17 04:41:39.259930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 473/956] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:39 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:39.461229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:39.461789 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:39.470294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.470717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.471790 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.472286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.531500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] HTTP exception thrown: Instance a076d3cd-b9c1-4802-bdae-3941d4348e7c could not be found. Feb 17 04:41:39.532280 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Returning 404 to user: Instance a076d3cd-b9c1-4802-bdae-3941d4348e7c could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:39.533192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b9d999eb-c3aa-4a85-ae8a-b0c10bfc50ce tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 404 len: 111 microversion: 2.1 time: 0.076757 Feb 17 04:41:39.533809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 484/957] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:39 2021] DELETE /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:39.543652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:39.544404 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] [instance: a076d3cd-b9c1-4802-bdae-3941d4348e7c] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:39.553497 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.554005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.554991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.555996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.616311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] HTTP exception thrown: Instance a076d3cd-b9c1-4802-bdae-3941d4348e7c could not be found. Feb 17 04:41:39.616311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] Returning 404 to user: Instance a076d3cd-b9c1-4802-bdae-3941d4348e7c could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:39.616311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-20d2c2ec-87ee-444c-a4e0-927a8316406b tempest-AttachVolumeShelveTestJSON-1370161364 tempest-AttachVolumeShelveTestJSON-1370161364-project] 10.222.0.73 "GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c" status: 404 len: 111 microversion: 2.1 time: 0.076013 Feb 17 04:41:39.616311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 474/958] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:39 2021] GET /compute/v2.1/servers/a076d3cd-b9c1-4802-bdae-3941d4348e7c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:40.278836 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:40.280190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:40.299439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:40.299885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:40.300737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:40.301228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:40.752730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.761999 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d1ba098-11c1-4c20-bad3-f7f1f401d540 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.488015 Feb 17 04:41:40.762724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 485/959] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:40 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:41.080559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-0a7b3286-1460-4ca3-ba19-ae8812a2084a req-18fbc454-3516-447e-bc03-86577deeca33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e", "name": "network-vif-plugged", "status": "completed", "tag": "e805da08-d0ad-4991-991c-1ff856e5f049"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:41.083024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:41.083024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:41.092976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0a7b3286-1460-4ca3-ba19-ae8812a2084a req-18fbc454-3516-447e-bc03-86577deeca33 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.093489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-0a7b3286-1460-4ca3-ba19-ae8812a2084a req-18fbc454-3516-447e-bc03-86577deeca33 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:41.111389 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-0a7b3286-1460-4ca3-ba19-ae8812a2084a req-18fbc454-3516-447e-bc03-86577deeca33 service nova] Creating event network-vif-plugged:e805da08-d0ad-4991-991c-1ff856e5f049 for instance c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e on hv-cinder-75995 Feb 17 04:41:41.116890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-0a7b3286-1460-4ca3-ba19-ae8812a2084a req-18fbc454-3516-447e-bc03-86577deeca33 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040125 Feb 17 04:41:41.117610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 475/960] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:41.628492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-863803864", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:41.700336 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] validate_networks() for None {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:41:41.781414 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:41.782196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:41.792074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.792591 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:41.793461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.793964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:42.039144 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:42.048512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5c671320-362d-4224-afbf-791d5fe0fa58 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1319 microversion: 2.1 time: 0.271709 Feb 17 04:41:42.049158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 476/961] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:41 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:42.148472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:41:42.149029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:41:42.149641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:41:42.150190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:41:42.150656 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:41:42.159924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:42.161330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:42.161654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:42.162153 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:42.182633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Getting quotas for project 8d451790c7e445b4840418eb6add49a4. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:41:42.187040 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Getting quotas for user 7e433af366ee472fa737c5e64d05df3b and project 8d451790c7e445b4840418eb6add49a4. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:41:42.200255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:41:42.202823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:41:42.326387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7292e29e-fd80-484c-ae07-7f7a6c393e8e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702080 Feb 17 04:41:42.327104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 486/962] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:41:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:41:42.338351 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-224d7e13-8b59-470d-ac82-a3deb88fc9ef tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:42.339013 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-224d7e13-8b59-470d-ac82-a3deb88fc9ef tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:42.504481 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-224d7e13-8b59-470d-ac82-a3deb88fc9ef tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:42.514678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-224d7e13-8b59-470d-ac82-a3deb88fc9ef tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1214 microversion: 2.1 time: 0.180643 Feb 17 04:41:42.515330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 477/963] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:42 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:43.069105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:43.069765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:43.078662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:43.079532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.080600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:43.081283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.534309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:43.535009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:43.543942 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:43.544455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.545309 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:43.545840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.558371 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.570596 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-df7a250c-b943-41f8-a6e1-cc78f5d74214 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1507 microversion: 2.1 time: 0.506342 Feb 17 04:41:43.580258 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 487/964] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:43 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:43.898881 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.922662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-91192e3c-a33e-4df0-97e5-88a1b7aefc61 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1210 microversion: 2.1 time: 0.392329 Feb 17 04:41:43.940507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 478/965] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:43 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1210 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:44.944046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:44.945400 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:44.954262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:44.954778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:44.955667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:44.956171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:45.106021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:45.117142 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-24cf64d0-a4cc-4d71-aef8-de27496cbf30 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1272 microversion: 2.1 time: 0.177378 Feb 17 04:41:45.118531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 488/966] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:44 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:46.139058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:46.140493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:46.150126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:46.150126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:46.151166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:46.151925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:46.329138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:46.341472 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-797c159b-e1d2-44a4-8f0a-bce7ea21778e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1272 microversion: 2.1 time: 0.208009 Feb 17 04:41:46.342498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 479/967] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:46 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:47.362321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:47.364401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:47.375855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:47.376672 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:47.377706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:47.378378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:47.882708 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:47.892090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8ca06552-6bb7-4315-bf10-9ebefaff2ab1 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1314 microversion: 2.1 time: 0.534066 Feb 17 04:41:47.893148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 489/968] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:47 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:48.740918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-81fd5324-e2b2-4cd7-92af-f94280c670e9 req-28e67fd0-e94d-40ed-8d29-fd02d58a3ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0d6e41-b789-4430-a65a-32a026587899", "tag": "8e08c065-933a-4c3d-a868-022ac7725d0a"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:48.753662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:48.753662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:48.753662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-81fd5324-e2b2-4cd7-92af-f94280c670e9 req-28e67fd0-e94d-40ed-8d29-fd02d58a3ade service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.753662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-81fd5324-e2b2-4cd7-92af-f94280c670e9 req-28e67fd0-e94d-40ed-8d29-fd02d58a3ade service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:48.782050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-81fd5324-e2b2-4cd7-92af-f94280c670e9 req-28e67fd0-e94d-40ed-8d29-fd02d58a3ade service nova] Creating event network-changed:8e08c065-933a-4c3d-a868-022ac7725d0a for instance 1a0d6e41-b789-4430-a65a-32a026587899 on hv-cinder-75995 Feb 17 04:41:48.789115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-81fd5324-e2b2-4cd7-92af-f94280c670e9 req-28e67fd0-e94d-40ed-8d29-fd02d58a3ade service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052213 Feb 17 04:41:48.793782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 480/969] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:48.912359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:48.913037 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:48.926216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.927056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:48.928716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.929409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:49.467938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:49.477346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cc4b93d9-f27d-4eec-a248-d54d063c8eae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1314 microversion: 2.1 time: 0.569211 Feb 17 04:41:49.479799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 490/970] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:48 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:50.501542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:50.502872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:50.518362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.519640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.521079 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.522219 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.999181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:51.008861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c706a37a-3f49-42f2-aee4-77e101247803 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1314 microversion: 2.1 time: 0.515711 Feb 17 04:41:51.009680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 481/971] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:50 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:52.027274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:52.028124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:52.037268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:52.037268 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:52.037855 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:52.038283 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:52.280577 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:52.295243 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4eb9222a-0ba5-405c-aa53-dd73c5441c7e tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1314 microversion: 2.1 time: 0.272016 Feb 17 04:41:52.305687 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 491/972] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:52 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:41:53.313745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:53.314628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:53.324597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.325524 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.326762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.328328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.572799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.588276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-057f915c-cb3a-43ce-8c4b-0355404d63c2 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1314 microversion: 2.1 time: 0.277912 Feb 17 04:41:53.589882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 482/973] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:53 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:53.601425 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-9cf8e89d-813e-45aa-b4d7-e6add259ce58 req-9ba10633-d586-4945-98fa-c9b73058cf39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0d6e41-b789-4430-a65a-32a026587899", "name": "network-vif-plugged", "status": "completed", "tag": "8e08c065-933a-4c3d-a868-022ac7725d0a"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:53.603859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:53.603859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:53.613458 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9cf8e89d-813e-45aa-b4d7-e6add259ce58 req-9ba10633-d586-4945-98fa-c9b73058cf39 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.614032 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-9cf8e89d-813e-45aa-b4d7-e6add259ce58 req-9ba10633-d586-4945-98fa-c9b73058cf39 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.633323 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-9cf8e89d-813e-45aa-b4d7-e6add259ce58 req-9ba10633-d586-4945-98fa-c9b73058cf39 service nova] Creating event network-vif-plugged:8e08c065-933a-4c3d-a868-022ac7725d0a for instance 1a0d6e41-b789-4430-a65a-32a026587899 on hv-cinder-75995 Feb 17 04:41:53.639445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-9cf8e89d-813e-45aa-b4d7-e6add259ce58 req-9ba10633-d586-4945-98fa-c9b73058cf39 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044415 Feb 17 04:41:53.640501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 492/974] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:54.616707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:54.618035 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:54.626631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.627118 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.628208 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.628910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.884100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.893295 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-db9c7b22-3287-4da6-94fd-965d38fa5378 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1314 microversion: 2.1 time: 0.281136 Feb 17 04:41:54.893899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 483/975] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:54 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:55.912136 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:55.922668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:55.922668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.922668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.922668 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.923815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.143837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.153461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-9a8caa4e-c205-4650-8e06-ab6b36c6ccce tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1463 microversion: 2.1 time: 0.246074 Feb 17 04:41:56.154065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 493/976] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:55 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1463 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:56.228402 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:56.229044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:56.237277 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.237788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.238634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.239128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.308976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:56.671985 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-04582c9c-465f-4267-bf68-6f82444bfaae tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 204 len: 0 microversion: 2.1 time: 0.448404 Feb 17 04:41:56.672557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 484/977] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:56 2021] DELETE /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:56.681476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:56.685849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:56.690919 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.691478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.692327 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.692815 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.915452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.924419 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4984d075-7dc9-42f5-8cd2-798b1f2f4828 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1469 microversion: 2.1 time: 0.247039 Feb 17 04:41:56.924959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 494/978] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:56 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:57.944010 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:57.944764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:57.952915 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:57.953420 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:57.954250 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:57.954785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.174229 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.183331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-09c2b69f-a5da-4524-9685-cb6eab34f3fd tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1469 microversion: 2.1 time: 0.243832 Feb 17 04:41:58.183972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 485/979] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:57 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:59.202051 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:59.202871 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:59.211246 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:59.211788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.212655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:59.213156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.441297 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:59.451921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0c59619f-4d2b-4daa-a36f-2779a6da3681 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1469 microversion: 2.1 time: 0.253890 Feb 17 04:41:59.452617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 495/980] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:59 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:59.732240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-3da40ae8-2065-444d-b348-98459f5ce51d req-5543b3ee-a2ce-445e-894e-92d521203712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0d6e41-b789-4430-a65a-32a026587899", "name": "network-vif-deleted", "tag": "8e08c065-933a-4c3d-a868-022ac7725d0a"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:59.734169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:59.734169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:41:59.745712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3da40ae8-2065-444d-b348-98459f5ce51d req-5543b3ee-a2ce-445e-894e-92d521203712 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:59.745712 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3da40ae8-2065-444d-b348-98459f5ce51d req-5543b3ee-a2ce-445e-894e-92d521203712 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.765645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-3da40ae8-2065-444d-b348-98459f5ce51d req-5543b3ee-a2ce-445e-894e-92d521203712 service nova] Creating event network-vif-deleted:8e08c065-933a-4c3d-a868-022ac7725d0a for instance 1a0d6e41-b789-4430-a65a-32a026587899 on hv-cinder-75995 Feb 17 04:41:59.771172 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-3da40ae8-2065-444d-b348-98459f5ce51d req-5543b3ee-a2ce-445e-894e-92d521203712 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043032 Feb 17 04:41:59.772717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 486/981] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:00.470627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:00.471343 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:00.480003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.480525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.481382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.481878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.560970 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.562039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.563050 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lazy-loading 'fault' on Instance uuid 1a0d6e41-b789-4430-a65a-32a026587899 {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:42:00.635852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e433af366ee472fa737c5e64d05df3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451790c7e445b4840418eb6add49a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:00.654217 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4b48287d-a9f1-4fac-812f-8601579af486 tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 200 len: 1304 microversion: 2.1 time: 0.187072 Feb 17 04:42:00.655369 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 496/982] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:00 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:01.218207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd566541-9bcd-4328-a740-6f122a120003", "device": "/dev/sdb"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:01.222191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:01.231469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.231995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.232884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.233385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.674670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:01.676093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] [instance: 1a0d6e41-b789-4430-a65a-32a026587899] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:01.686785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.687435 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.690566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.690566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.784893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] HTTP exception thrown: Instance 1a0d6e41-b789-4430-a65a-32a026587899 could not be found. Feb 17 04:42:01.785627 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] Returning 404 to user: Instance 1a0d6e41-b789-4430-a65a-32a026587899 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:42:01.786821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-937ca573-f6a0-4f7f-9c83-6579ada9c1cf tempest-VolumesNegativeTest-1934507107 tempest-VolumesNegativeTest-1934507107-project] 10.222.0.73 "GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899" status: 404 len: 111 microversion: 2.1 time: 0.116414 Feb 17 04:42:01.787502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 497/983] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:01 2021] GET /compute/v2.1/servers/1a0d6e41-b789-4430-a65a-32a026587899 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:42:01.930403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5f55b828-80ef-44d4-a00a-4274129ae521 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "POST /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716239 Feb 17 04:42:01.930767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 487/984] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:42:01 2021] POST /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:20.954561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:42:20.955484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:42:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:42:30.853918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:30.854469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:30.862678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.863193 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:30.864123 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.864621 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:31.046821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lazy-loading 'services' on Instance uuid c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e {{(pid=98222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:42:31.265188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b9885965-32a1-4209-a726-35dd23e78893 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e/os-volume_attachments/cd566541-9bcd-4328-a740-6f122a120003" status: 202 len: 0 microversion: 2.1 time: 0.415779 Feb 17 04:42:31.265764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 498/985] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:42:30 2021] DELETE /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e/os-volume_attachments/cd566541-9bcd-4328-a740-6f122a120003 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:32.497797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:32.499190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:32.510058 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.510549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.511465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.511957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.577723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:42:32.786720 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-81710b19-ed22-4f00-a0d7-56de3f195071 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 204 len: 0 microversion: 2.1 time: 0.295818 Feb 17 04:42:32.787547 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 488/986] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:42:32 2021] DELETE /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:42:32.797188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:32.798098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:32.807165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.807741 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.808567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.809062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:33.031022 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:33.040163 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-765befe6-b519-4bf9-9b1f-cc3782abaa3e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1513 microversion: 2.1 time: 0.247514 Feb 17 04:42:33.040799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 499/987] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:32 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:34.059757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:34.060502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:34.068464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:34.068986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:34.069860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:34.070370 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:34.288086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:34.297024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ba88f694-016d-4343-aae3-8f2d27da1de8 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1513 microversion: 2.1 time: 0.241876 Feb 17 04:42:34.297652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 489/988] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:34 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:35.317240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:35.317850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:35.327006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.327539 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.328440 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.328929 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.469983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:35.480450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1b5a7d72-07a2-45b0-bcf4-8b653cf27025 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 200 len: 1471 microversion: 2.1 time: 0.168689 Feb 17 04:42:35.481062 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 500/989] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:35 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:35.621582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-a464559e-742e-44a7-a10a-d5f02ca11172 req-f87c684c-b2f4-4049-92ed-3aac0136f6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e", "name": "network-vif-deleted", "tag": "e805da08-d0ad-4991-991c-1ff856e5f049"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:35.623477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:35.623477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:42:35.638073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a464559e-742e-44a7-a10a-d5f02ca11172 req-f87c684c-b2f4-4049-92ed-3aac0136f6a7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.638597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a464559e-742e-44a7-a10a-d5f02ca11172 req-f87c684c-b2f4-4049-92ed-3aac0136f6a7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.664030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-a464559e-742e-44a7-a10a-d5f02ca11172 req-f87c684c-b2f4-4049-92ed-3aac0136f6a7 service nova] Creating event network-vif-deleted:e805da08-d0ad-4991-991c-1ff856e5f049 for instance c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e on hv-cinder-75995 Feb 17 04:42:35.669465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-a464559e-742e-44a7-a10a-d5f02ca11172 req-f87c684c-b2f4-4049-92ed-3aac0136f6a7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052103 Feb 17 04:42:35.670321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 490/990] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:36.499194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:36.499924 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:36.507845 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.508353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:36.509194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.509688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:36.562170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] HTTP exception thrown: Instance c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e could not be found. Feb 17 04:42:36.562761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Returning 404 to user: Instance c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:42:36.563694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-029cb2aa-539b-4abf-a8ed-e1f354187acd tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e" status: 404 len: 111 microversion: 2.1 time: 0.068617 Feb 17 04:42:36.564296 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 501/991] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:36 2021] GET /compute/v2.1/servers/c14cecc0-e1fc-45c3-8269-8ad8e21c6a3e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:42:43.045382 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '.version_select at 0x7f9b4125ca60>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:43.551603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:43.561093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.561578 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.562427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.562925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.626391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Acquired lock "refresh_cache-d78384a9-70f3-4b71-afd3-75be242a9c9e" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:42:45.502300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Building network info cache for instance {{(pid=98221) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:42:45.510857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-a0e4444f-26bc-48bf-b405-c26a8b38e65b req-eb7ac05f-169d-4e7a-b8b4-c49a41800ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:45.513165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:45.513165 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:42:45.523023 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a0e4444f-26bc-48bf-b405-c26a8b38e65b req-eb7ac05f-169d-4e7a-b8b4-c49a41800ef1 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:45.523690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-a0e4444f-26bc-48bf-b405-c26a8b38e65b req-eb7ac05f-169d-4e7a-b8b4-c49a41800ef1 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:45.543586 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-a0e4444f-26bc-48bf-b405-c26a8b38e65b req-eb7ac05f-169d-4e7a-b8b4-c49a41800ef1 service nova] Creating event network-changed:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:42:45.549249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-a0e4444f-26bc-48bf-b405-c26a8b38e65b req-eb7ac05f-169d-4e7a-b8b4-c49a41800ef1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042390 Feb 17 04:42:45.550026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 502/992] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:46.807613 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Updating instance_info_cache with network_info: [{"id": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0", "address": "fa:16:3e:d2:19:f5", "network": {"id": "1e85d977-59c3-4c3c-9bba-18bb58ffd3cd", "bridge": "br-int", "label": "tempest-TestShelveInstance-330157398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d447f221703e4725a470bab1096716e0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapcd4c018b-0a", "ovs_interfaceid": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98221) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:42:46.876831 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Releasing lock "refresh_cache-d78384a9-70f3-4b71-afd3-75be242a9c9e" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:42:46.877801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-155b3082-76d0-4fb5-b68b-dc02a52e859e tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/90f089ce-30da-4167-9fb2-b7aef340ca75" status: 202 len: 0 microversion: 2.1 time: 3.838566 Feb 17 04:42:46.878461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 491/993] 10.222.0.73 () {58 vars in 1253 bytes} [Wed Feb 17 04:42:43 2021] DELETE /compute/v2.1/os-floating-ips/90f089ce-30da-4167-9fb2-b7aef340ca75 => generated 0 bytes in 3840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:46.889065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:46.889775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:46.898409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:46.898923 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:46.899825 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:46.900326 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:46.968043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:42:47.195978 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e30bfed4-9a04-43f6-94f1-f2d0ebd023fe tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 204 len: 0 microversion: 2.1 time: 0.311897 Feb 17 04:42:47.196753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 503/994] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:42:46 2021] DELETE /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:42:47.206094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:47.207096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:47.215760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:47.216629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:47.218441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:47.218441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:47.333509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1330285738", "imageRef": "8ee08385-7fbf-40d1-a15c-56f8a1a98b2d", "flavorRef": "452", "networks": [{"uuid": "03e92244-b0e1-440a-bd01-1b65157a154e"}]}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:47.405436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] validate_networks() for [('03e92244-b0e1-440a-bd01-1b65157a154e', None, None, None)] {{(pid=98222) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:42:47.633793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:47.643816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b8446c38-b8eb-4b20-9dc0-fcf993e6c28c tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1452 microversion: 2.1 time: 0.442334 Feb 17 04:42:47.644663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 492/995] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:47 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1452 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:48.181490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Flavor limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:42:48.182012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Image limits 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:42:48.182487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Flavor pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:42:48.182954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Image pref 0:0:0 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:42:48.183473 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:42:48.193791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.194846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.195093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.195649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.214823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Getting quotas for project d222969e9f8c4c679e15b8cafb6e2f9d. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:42:48.219119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Getting quotas for user 2be87370014d4ff390aa0b2bb2b01d48 and project d222969e9f8c4c679e15b8cafb6e2f9d. Resources: {'instances', 'cores', 'ram'} {{(pid=98222) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:42:48.231077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Going to run 1 instances... {{(pid=98222) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:42:48.233869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee08385-7fbf-40d1-a15c-56f8a1a98b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:42:48.354769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ffa6cb9b-5461-42fe-a320-60d1eff520e0 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026356 Feb 17 04:42:48.355519 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 504/996] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:42:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:42:48.366262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1c427f30-b994-4598-9351-6ce0631d5660 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:48.366930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1c427f30-b994-4598-9351-6ce0631d5660 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:48.492832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1c427f30-b994-4598-9351-6ce0631d5660 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:48.503360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1c427f30-b994-4598-9351-6ce0631d5660 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1219 microversion: 2.1 time: 0.141054 Feb 17 04:42:48.504086 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 493/997] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:48 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:48.667274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:48.668094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:48.676622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.687465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.687465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.687465 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.922986 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:48.932647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d11255a1-8b75-4435-899d-018ddcd3eedc tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1452 microversion: 2.1 time: 0.270040 Feb 17 04:42:48.933317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 505/998] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:48 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1452 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:49.521868 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:49.522652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:49.531727 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.532333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:49.533360 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.533927 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:49.714948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:49.724873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3a0cde18-e6d2-43d9-ac7c-7342f5005157 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1271 microversion: 2.1 time: 0.207071 Feb 17 04:42:49.725597 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 494/999] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:49 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:49.952106 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:49.952778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:49.961190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.961702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:49.962667 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.963162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:50.195061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:50.205612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-58f4ac19-e288-4022-bb8a-2c2ed4af8fcb tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1452 microversion: 2.1 time: 0.258031 Feb 17 04:42:50.206233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 506/1000] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:49 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1452 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:50.743542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:50.744242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:50.752629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:50.753140 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:50.754003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:50.754497 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.048480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:51.058487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f271961b-c3ee-4cf7-8760-915607d373a4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1277 microversion: 2.1 time: 0.319032 Feb 17 04:42:51.067891 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 495/1001] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:50 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:51.224935 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:51.225625 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:51.234269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.234770 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.235911 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.236417 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.719976 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:51.733156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f931e051-e6b1-47a3-97f9-a28f80536015 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1452 microversion: 2.1 time: 0.512438 Feb 17 04:42:51.734290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 507/1002] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:51 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1452 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:52.079746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:52.081540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:52.091670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.093104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:52.094196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.094889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:52.414487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-03f0b44d-1385-4ef5-b821-37d4b04a5a9b req-19acac14-6bc4-4c0b-9144-a555a0667647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78384a9-70f3-4b71-afd3-75be242a9c9e", "name": "network-vif-deleted", "tag": "cd4c018b-0a0e-4867-bde5-2a4cd164bda0"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:52.416408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:52.416408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:42:52.426358 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-03f0b44d-1385-4ef5-b821-37d4b04a5a9b req-19acac14-6bc4-4c0b-9144-a555a0667647 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.426996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-03f0b44d-1385-4ef5-b821-37d4b04a5a9b req-19acac14-6bc4-4c0b-9144-a555a0667647 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:52.447116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-03f0b44d-1385-4ef5-b821-37d4b04a5a9b req-19acac14-6bc4-4c0b-9144-a555a0667647 service nova] Creating event network-vif-deleted:cd4c018b-0a0e-4867-bde5-2a4cd164bda0 for instance d78384a9-70f3-4b71-afd3-75be242a9c9e on hv-cinder-75995 Feb 17 04:42:52.453044 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-03f0b44d-1385-4ef5-b821-37d4b04a5a9b req-19acac14-6bc4-4c0b-9144-a555a0667647 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042844 Feb 17 04:42:52.453719 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 508/1003] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:52.754141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:52.755126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:52.764740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.765438 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:52.766521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.767025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:52.929359 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:52.939074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2e43fa8a-741e-414c-800a-d7f032523a5c tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.866208 Feb 17 04:42:52.940084 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 496/1004] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:52 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:52.964930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35be49abea3449ea8d25e8e83ccc8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd447f221703e4725a470bab1096716e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:52.974292 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fc953f1e-d29b-4340-8625-91be5c3d7782 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 200 len: 1218 microversion: 2.1 time: 0.224928 Feb 17 04:42:52.974931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 509/1005] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:52 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:53.875824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-13b31a5d-3cca-4dc3-95de-7311adb06d37 req-f77e8bdf-7d96-4778-b072-8547668e4f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c38376-4358-4e1c-b8e1-9dd30d8563c8", "tag": "4eabac41-4358-4828-be38-b750e8266c3e"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:53.878251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:53.878251 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:42:53.888201 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-13b31a5d-3cca-4dc3-95de-7311adb06d37 req-f77e8bdf-7d96-4778-b072-8547668e4f3e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.892883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-13b31a5d-3cca-4dc3-95de-7311adb06d37 req-f77e8bdf-7d96-4778-b072-8547668e4f3e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.906903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-13b31a5d-3cca-4dc3-95de-7311adb06d37 req-f77e8bdf-7d96-4778-b072-8547668e4f3e service nova] Creating event network-changed:4eabac41-4358-4828-be38-b750e8266c3e for instance a7c38376-4358-4e1c-b8e1-9dd30d8563c8 on hv-cinder-75995 Feb 17 04:42:53.912463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-13b31a5d-3cca-4dc3-95de-7311adb06d37 req-f77e8bdf-7d96-4778-b072-8547668e4f3e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040863 Feb 17 04:42:53.913406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 497/1006] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:53.957761 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:53.958441 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:53.977348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.977903 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.978769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.979352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.994189 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:53.995019 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] [instance: d78384a9-70f3-4b71-afd3-75be242a9c9e] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:54.003824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:54.004644 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.005885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:54.006694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.067832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] HTTP exception thrown: Instance d78384a9-70f3-4b71-afd3-75be242a9c9e could not be found. Feb 17 04:42:54.068893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Returning 404 to user: Instance d78384a9-70f3-4b71-afd3-75be242a9c9e could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:42:54.069782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a42109e3-9966-4a04-aeb2-0577d3afd919 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e" status: 404 len: 111 microversion: 2.1 time: 0.080182 Feb 17 04:42:54.070384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 498/1007] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:53 2021] GET /compute/v2.1/servers/d78384a9-70f3-4b71-afd3-75be242a9c9e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:42:54.080212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6297bd08-dedf-4ea0-bb79-5950f9a55cd6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '.version_select at 0x7f9b2ff3cd08>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:54.225782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:54.241951 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-96eb254c-e9d9-4ee6-8a73-fc6466ae1ea9 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.287762 Feb 17 04:42:54.242964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 510/1008] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:53 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:54.794459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6297bd08-dedf-4ea0-bb79-5950f9a55cd6 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/7c192d6c-d625-4515-ab61-65b63dde532c" status: 202 len: 0 microversion: 2.1 time: 0.718397 Feb 17 04:42:54.795115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 499/1009] 10.222.0.73 () {58 vars in 1262 bytes} [Wed Feb 17 04:42:54 2021] DELETE /compute/v2.1/os-security-groups/7c192d6c-d625-4515-ab61-65b63dde532c => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:54.803826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e5788839-8e37-44cc-b3ee-ae747c293737 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] Calling method '.version_select at 0x7f9b3c01ae18>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:54.850446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e5788839-8e37-44cc-b3ee-ae747c293737 tempest-TestShelveInstance-1504623903 tempest-TestShelveInstance-1504623903-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-530059094" status: 202 len: 0 microversion: 2.1 time: 0.050469 Feb 17 04:42:54.851120 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 511/1010] 10.222.0.73 () {58 vars in 1241 bytes} [Wed Feb 17 04:42:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-530059094 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:55.261875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:55.262542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:55.270457 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:55.270964 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:55.271828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:55.272319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:55.497439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:55.506664 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1250daea-00d2-47e1-bfbd-f3be9a643462 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.249400 Feb 17 04:42:55.507307 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 500/1011] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:55 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:56.525226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:56.525998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:56.534681 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.535167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.536103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.536854 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.789707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:56.799931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-61ee6d64-d514-4fdb-8257-904ac3c85b3a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.278898 Feb 17 04:42:56.800640 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 512/1012] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:56 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:57.818694 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:57.819409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:57.827860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.828345 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:57.829436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.829920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:58.063247 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:58.072442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0b7c60a0-fbd1-4fa3-a7ce-4428649880d2 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.258006 Feb 17 04:42:58.073063 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 501/1013] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:57 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:59.090872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:59.091582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:59.117521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.120363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.122128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.123231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.734489 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:59.742982 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0e9cb415-eb0d-4eff-bf1e-5331c2288b16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.656102 Feb 17 04:42:59.743634 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 513/1014] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:59 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:00.761006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:00.762353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:00.770600 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:00.771431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:00.772451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:00.778527 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:01.016334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:01.027236 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d65cd4f8-1053-4a64-a593-008b0185136b tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.270150 Feb 17 04:43:01.027882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 502/1015] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:00 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:01.689646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d928c30c-23e4-41f0-bbb1-1e209973794a req-79a49ef9-890c-4e35-9551-d9a6e3bb84cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c38376-4358-4e1c-b8e1-9dd30d8563c8", "name": "network-vif-plugged", "status": "completed", "tag": "4eabac41-4358-4828-be38-b750e8266c3e"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:01.691759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:01.691759 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:43:01.702521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d928c30c-23e4-41f0-bbb1-1e209973794a req-79a49ef9-890c-4e35-9551-d9a6e3bb84cc service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:01.703380 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d928c30c-23e4-41f0-bbb1-1e209973794a req-79a49ef9-890c-4e35-9551-d9a6e3bb84cc service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:01.733137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d928c30c-23e4-41f0-bbb1-1e209973794a req-79a49ef9-890c-4e35-9551-d9a6e3bb84cc service nova] Creating event network-vif-plugged:4eabac41-4358-4828-be38-b750e8266c3e for instance a7c38376-4358-4e1c-b8e1-9dd30d8563c8 on hv-cinder-75995 Feb 17 04:43:01.738514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d928c30c-23e4-41f0-bbb1-1e209973794a req-79a49ef9-890c-4e35-9551-d9a6e3bb84cc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054074 Feb 17 04:43:01.739479 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 514/1016] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:02.047796 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:02.050094 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:02.059535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:02.060328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:02.061349 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:02.062002 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:02.301152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:02.310671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2a071826-9c66-4c02-adb3-25b70de2f6fc tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.268263 Feb 17 04:43:02.311299 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 503/1017] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:02 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:03.329641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:03.330680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:03.346839 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:03.352396 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:03.354298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:03.354967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:04.017890 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:04.026914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-68ac2fe4-7021-4db5-a32d-e46f5f55d5f4 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1319 microversion: 2.1 time: 0.701871 Feb 17 04:43:04.027632 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 515/1018] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:03 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:05.046128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:05.046804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:05.055852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.056666 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.057856 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.058675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.352850 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:05.362483 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-382d7fb7-71a9-416f-a3f3-9a31a540de69 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1507 microversion: 2.1 time: 0.321055 Feb 17 04:43:05.375756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 504/1019] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:05 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:05.380811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc96f57c-b9c9-43e7-99c2-40dfb3cbfe43", "device": "/dev/sdb"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:05.382947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:05.398476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.399390 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.400647 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.401306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:06.141807 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7d81beeb-ed12-404c-8318-1b2030d7194a tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "POST /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763594 Feb 17 04:43:06.143610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 516/1020] 10.222.0.73 () {60 vars in 1313 bytes} [Wed Feb 17 04:43:05 2021] POST /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:27.222592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:27.223152 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:27.232886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:27.233801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:27.234764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:27.235509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:27.445636 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lazy-loading 'services' on Instance uuid a7c38376-4358-4e1c-b8e1-9dd30d8563c8 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:43:27.747133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3e0e9a59-be17-415a-b75c-f9f552a3b76d tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8/os-volume_attachments/dc96f57c-b9c9-43e7-99c2-40dfb3cbfe43" status: 202 len: 0 microversion: 2.1 time: 0.525462 Feb 17 04:43:27.748096 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 505/1021] 10.222.0.73 () {58 vars in 1406 bytes} [Wed Feb 17 04:43:27 2021] DELETE /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8/os-volume_attachments/dc96f57c-b9c9-43e7-99c2-40dfb3cbfe43 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:43:29.155526 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:29.157387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:29.186468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:29.190840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:29.190840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:29.190840 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:29.310184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:43:29.547324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d4dcf874-ecbc-4645-8e66-9367d1f9fc85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 204 len: 0 microversion: 2.1 time: 0.399988 Feb 17 04:43:29.548186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 517/1022] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:43:29 2021] DELETE /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:43:29.558885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:29.560028 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:29.573183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:29.574127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:29.575214 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:29.576412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:29.972961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:29.985956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c097559e-c425-402b-98f2-c340e3cd88c5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1513 microversion: 2.1 time: 0.432549 Feb 17 04:43:29.987072 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 506/1023] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:29 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1513 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:31.007262 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:31.010638 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:31.024496 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:31.025017 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:31.025875 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:31.026385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:31.666320 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:31.679477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-57a23161-f188-4b47-b0e7-e2c6dfd39aca tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1513 microversion: 2.1 time: 0.677157 Feb 17 04:43:31.680793 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 518/1024] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:31 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1513 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:32.701739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-faa09eb0-5457-4e7a-b8af-a5dac2e7ca69 req-6b2f78e6-d9ad-4924-b54c-95a7adbf4bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c38376-4358-4e1c-b8e1-9dd30d8563c8", "name": "network-vif-deleted", "tag": "4eabac41-4358-4828-be38-b750e8266c3e"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:32.702356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ceaaee0a-f5d8-40e1-be30-c82bca1b0a09 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b3d214b70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1321970644"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:32.703945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:32.703945 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:43:32.716186 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-faa09eb0-5457-4e7a-b8af-a5dac2e7ca69 req-6b2f78e6-d9ad-4924-b54c-95a7adbf4bb7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:32.717561 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-faa09eb0-5457-4e7a-b8af-a5dac2e7ca69 req-6b2f78e6-d9ad-4924-b54c-95a7adbf4bb7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:32.738879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-ceaaee0a-f5d8-40e1-be30-c82bca1b0a09 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:43:32.744862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-ceaaee0a-f5d8-40e1-be30-c82bca1b0a09 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for user af5ffc1a33c849b69068092abe9f6d88 and project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:43:32.770955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-faa09eb0-5457-4e7a-b8af-a5dac2e7ca69 req-6b2f78e6-d9ad-4924-b54c-95a7adbf4bb7 service nova] Creating event network-vif-deleted:4eabac41-4358-4828-be38-b750e8266c3e for instance a7c38376-4358-4e1c-b8e1-9dd30d8563c8 on hv-cinder-75995 Feb 17 04:43:32.778612 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-faa09eb0-5457-4e7a-b8af-a5dac2e7ca69 req-6b2f78e6-d9ad-4924-b54c-95a7adbf4bb7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084943 Feb 17 04:43:32.783012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 519/1025] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:43:32.787902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:32.788849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:32.800487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:32.801072 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:32.802009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:32.802582 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:33.009715 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:33.026275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-27402361-18d8-46a4-be52-e3df4712cf85 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1304 microversion: 2.1 time: 0.245268 Feb 17 04:43:33.027238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 520/1026] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:32 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:33.099428 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-ceaaee0a-f5d8-40e1-be30-c82bca1b0a09 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:43:33.105559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-ceaaee0a-f5d8-40e1-be30-c82bca1b0a09 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for user af5ffc1a33c849b69068092abe9f6d88 and project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'key_pairs'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:43:33.119732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ceaaee0a-f5d8-40e1-be30-c82bca1b0a09 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.673729 Feb 17 04:43:33.120509 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 507/1027] 10.222.0.73 () {60 vars in 1148 bytes} [Wed Feb 17 04:43:32 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:33.131502 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b7f1e8ca-188c-47da-87ed-18858b1c295f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b412579d8>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-511321096", "description": "tempest-TestVolumeBootPattern-511321096 description"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:33.461196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b7f1e8ca-188c-47da-87ed-18858b1c295f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.333910 Feb 17 04:43:33.461925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 521/1028] 10.222.0.73 () {60 vars in 1170 bytes} [Wed Feb 17 04:43:33 2021] POST /compute/v2.1/os-security-groups => generated 249 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:33.473912 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-383ca173-6665-4599-8773-170b819d43c1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b3d2149d8>, body: {"security_group_rule": {"parent_group_id": "fcc9b4cd-f53a-4367-ac89-10d39a04b2c8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:33.819077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-383ca173-6665-4599-8773-170b819d43c1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.348838 Feb 17 04:43:33.825374 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 508/1029] 10.222.0.73 () {60 vars in 1185 bytes} [Wed Feb 17 04:43:33 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:33.832286 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-d503bc21-1e55-404b-8553-ceec5ba32b61 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b2ff0a730>, body: {"security_group_rule": {"parent_group_id": "fcc9b4cd-f53a-4367-ac89-10d39a04b2c8", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:34.050758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:34.052303 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:34.073446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:34.074004 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:34.074918 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:34.075450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:34.165505 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:34.166065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:34.166633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lazy-loading 'fault' on Instance uuid a7c38376-4358-4e1c-b8e1-9dd30d8563c8 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:43:34.329328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:34.339127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8c0b38ac-dac1-4f14-ba29-638b8822ee16 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1309 microversion: 2.1 time: 0.293117 Feb 17 04:43:34.339781 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 509/1030] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:34 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:34.354239 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-d503bc21-1e55-404b-8553-ceec5ba32b61 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.526636 Feb 17 04:43:34.355799 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 522/1031] 10.222.0.73 () {60 vars in 1185 bytes} [Wed Feb 17 04:43:33 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:35.359056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:35.359872 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:35.368256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:35.368885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:35.369826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:35.370409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:35.447931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:35.448315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:35.448847 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.objects.instance [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lazy-loading 'fault' on Instance uuid a7c38376-4358-4e1c-b8e1-9dd30d8563c8 {{(pid=98221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:43:35.527618 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be87370014d4ff390aa0b2bb2b01d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd222969e9f8c4c679e15b8cafb6e2f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:35.534466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4fdb11b3-ab29-455b-850b-5ab0711a6bb5 tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 200 len: 1309 microversion: 2.1 time: 0.179818 Feb 17 04:43:35.535105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 510/1032] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:35 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 1309 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:36.554490 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:36.555331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] [instance: a7c38376-4358-4e1c-b8e1-9dd30d8563c8] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:36.568169 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:36.568686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:36.569525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:36.570197 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:36.625270 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] HTTP exception thrown: Instance a7c38376-4358-4e1c-b8e1-9dd30d8563c8 could not be found. Feb 17 04:43:36.625958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] Returning 404 to user: Instance a7c38376-4358-4e1c-b8e1-9dd30d8563c8 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:43:36.626887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4e043bbc-54d7-4b41-95a7-a51ec1ae836e tempest-VolumesSnapshotTestJSON-1349058073 tempest-VolumesSnapshotTestJSON-1349058073-project] 10.222.0.73 "GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8" status: 404 len: 111 microversion: 2.1 time: 0.076979 Feb 17 04:43:36.627558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 523/1033] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:36 2021] GET /compute/v2.1/servers/a7c38376-4358-4e1c-b8e1-9dd30d8563c8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:43:57.706658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1977222524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1321970644", "security_groups": [{"name": "tempest-TestVolumeBootPattern-511321096"}], "block_device_mapping_v2": [{"uuid": "80679f58-59f7-4599-a6d8-fb353fb5fc98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:58.237833 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] validate_networks() for [('4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:43:58.913294 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:43:58.913774 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:43:58.914306 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:43:58.914810 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:43:58.915308 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:43:58.924692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:58.925216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:58.926158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:58.926686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:58.946671 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:43:58.951000 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for user af5ffc1a33c849b69068092abe9f6d88 and project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:43:59.057928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:43:59.061070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80679f58-59f7-4599-a6d8-fb353fb5fc98',volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:43:59.398768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [32f83a1b-bbb6-42c7-8a9a-6444bb44eb37] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:44:00.416315 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [32f83a1b-bbb6-42c7-8a9a-6444bb44eb37] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56346. Feb 17 04:44:00.421641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-47dfaaf1-f1a4-4438-a2d2-ec35001b3032 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 2.719404 Feb 17 04:44:00.422518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 511/1034] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:43:57 2021] POST /compute/v2.1/servers => generated 412 bytes in 2721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:44:00.433395 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-78e56f65-db5c-48d0-9700-87877fb11d48 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:00.434674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-78e56f65-db5c-48d0-9700-87877fb11d48 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:00.515888 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-78e56f65-db5c-48d0-9700-87877fb11d48 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:00.524940 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-78e56f65-db5c-48d0-9700-87877fb11d48 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1095 microversion: 2.1 time: 0.095630 Feb 17 04:44:00.525575 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 524/1035] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:00 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:01.543305 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:01.543992 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:01.552317 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:01.552837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:01.553688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:01.554183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:01.694192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:01.705244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e2b94d9d-ef81-417f-8154-161dc174ddeb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1137 microversion: 2.1 time: 0.165955 Feb 17 04:44:01.706137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 512/1036] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:01 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1137 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:02.736116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:02.736116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:02.740740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:02.741196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:02.742061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:02.742558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:02.871995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:02.880925 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1e79bea8-9006-4d20-91a3-83255572c258 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1211 microversion: 2.1 time: 0.153540 Feb 17 04:44:02.881675 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 525/1037] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:02 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:03.900200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:03.901133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:03.910166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:03.910725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:03.911887 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:03.912469 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:04.523125 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:04.533103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0a80a008-7e47-4b0b-beb8-aa230f8bad7b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.636781 Feb 17 04:44:04.533723 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 513/1038] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:03 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:05.449329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-89b42d1d-053e-487e-a3a8-f5c9e2e69a1f req-57717878-f0d3-4589-bb06-d07440928f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6069f33d-afb9-47ee-a8e0-0fcd27257701", "tag": "01cd63ef-7328-49da-8698-91a752e80431"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:05.451253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:05.451253 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:44:05.460884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-89b42d1d-053e-487e-a3a8-f5c9e2e69a1f req-57717878-f0d3-4589-bb06-d07440928f18 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:05.461520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-89b42d1d-053e-487e-a3a8-f5c9e2e69a1f req-57717878-f0d3-4589-bb06-d07440928f18 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:05.488625 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-89b42d1d-053e-487e-a3a8-f5c9e2e69a1f req-57717878-f0d3-4589-bb06-d07440928f18 service nova] Creating event network-changed:01cd63ef-7328-49da-8698-91a752e80431 for instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 on hv-cinder-75995 Feb 17 04:44:05.495876 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-89b42d1d-053e-487e-a3a8-f5c9e2e69a1f req-57717878-f0d3-4589-bb06-d07440928f18 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050098 Feb 17 04:44:05.497006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 526/1039] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:05.551184 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:05.552194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:05.561298 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:05.562041 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:05.562883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:05.563711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:05.932822 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:05.942663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0fdfb2f2-718a-48e6-a7c6-da86da34dc33 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.395443 Feb 17 04:44:05.943269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 514/1040] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:05 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:06.962556 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:06.963353 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:06.972039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:06.973039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:06.973816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:06.974316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:07.210446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:07.220179 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-70f5832b-c8dc-4ad2-80b3-b82aae9b6625 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.262205 Feb 17 04:44:07.220801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 527/1041] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:06 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:08.239115 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:08.239809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:08.247877 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:08.248397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:08.249259 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:08.249758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:08.490319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:08.500101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-852820f2-1911-4753-8d2e-b5ab0f22a28b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.264859 Feb 17 04:44:08.501319 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 515/1042] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:08 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:09.519517 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:09.520181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:09.528352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:09.529085 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:09.530015 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:09.530501 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:09.748859 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:09.758728 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e5c86314-cc21-4c0b-928b-b97050aef99f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.243323 Feb 17 04:44:09.759464 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 528/1043] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:09 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:10.777463 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:10.778220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:10.786587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:10.787099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:10.787989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:10.788484 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:11.002803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:11.012158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3148e73c-2418-4da7-899e-5956d983c29e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.238701 Feb 17 04:44:11.012788 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 516/1044] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:10 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:12.030429 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:12.031105 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:12.039352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:12.039869 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:12.040767 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:12.041271 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:12.259812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:12.268954 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-db082dfe-8186-4d3f-a7da-f7c12683a052 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.242557 Feb 17 04:44:12.269572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 529/1045] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:12 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:13.288787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:13.289474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:13.298459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:13.298961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:13.299857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:13.300356 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:13.524442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:13.534059 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-563ffb28-2212-4e1d-af84-b72c28e054d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.249698 Feb 17 04:44:13.534947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 517/1046] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:13 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:14.552688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:14.553361 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:14.561499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:14.561953 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:14.562852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:14.563401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:14.783906 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:14.793171 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-55dc59e9-5904-474d-aebb-aa1daae422d3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.244444 Feb 17 04:44:14.793655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 530/1047] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:14 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:15.811346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:15.811955 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:15.819988 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:15.820493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:15.821330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:15.821823 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:16.039589 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:16.048588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-310dc588-5de9-4d58-a716-259d6a889eec tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.241500 Feb 17 04:44:16.049183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 518/1048] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:15 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:17.067107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:17.067801 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:17.075782 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:17.076301 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:17.077146 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:17.077649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:17.287290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:17.296688 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f365bf84-c708-43f7-a5aa-b5d25f651e28 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.233685 Feb 17 04:44:17.297293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 531/1049] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:17 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:18.179914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-bc250a8f-93ca-40f4-999f-1154b249a067 req-5ade9ce0-c87f-45d5-8ba9-d5896b1eefcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6069f33d-afb9-47ee-a8e0-0fcd27257701", "name": "network-vif-plugged", "status": "completed", "tag": "01cd63ef-7328-49da-8698-91a752e80431"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:18.181725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:18.181725 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:44:18.190624 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-bc250a8f-93ca-40f4-999f-1154b249a067 req-5ade9ce0-c87f-45d5-8ba9-d5896b1eefcc service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:18.191127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-bc250a8f-93ca-40f4-999f-1154b249a067 req-5ade9ce0-c87f-45d5-8ba9-d5896b1eefcc service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:18.208670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-bc250a8f-93ca-40f4-999f-1154b249a067 req-5ade9ce0-c87f-45d5-8ba9-d5896b1eefcc service nova] Creating event network-vif-plugged:01cd63ef-7328-49da-8698-91a752e80431 for instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 on hv-cinder-75995 Feb 17 04:44:18.213907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-bc250a8f-93ca-40f4-999f-1154b249a067 req-5ade9ce0-c87f-45d5-8ba9-d5896b1eefcc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037984 Feb 17 04:44:18.214630 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 519/1050] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:18.318732 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:18.319482 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:18.331889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:18.331889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:18.331889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:18.331889 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:18.546227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:18.555176 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-25f99fcb-2989-4f4e-ab1e-f46767d20e30 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.244258 Feb 17 04:44:18.555849 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 532/1051] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:18 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:19.574554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:19.575339 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:19.583594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:19.584099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:19.584939 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:19.585432 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:20.035166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:20.044397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8ba61f52-72ff-44c9-9be2-dc0d99d0da22 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.474397 Feb 17 04:44:20.044998 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 520/1052] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:19 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:21.062522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:21.063119 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:21.071043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:21.071606 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:21.072448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:21.072946 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:21.286648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:21.295907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8078c091-a095-4d2a-909c-0d982e9ecafc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.237546 Feb 17 04:44:21.296522 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 533/1053] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:21 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:22.315110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:22.316012 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:22.324738 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:22.325377 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:22.326471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:22.327048 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:22.548654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:22.557510 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6d96c921-db0f-445f-8d64-247cf7883b1c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1273 microversion: 2.1 time: 0.246763 Feb 17 04:44:22.558104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 521/1054] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:22 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:23.575777 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:23.576581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:23.585237 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:23.585750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:23.586669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:23.587162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:23.824562 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:23.833699 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5bf2f8f6-6ee2-4499-982a-bc7c65a13a8a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1461 microversion: 2.1 time: 0.262122 Feb 17 04:44:23.834311 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 534/1055] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:23 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1461 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:23.854043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:23.854716 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:23.863629 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:23.864143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:23.865003 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:23.865551 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:24.083520 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:24.092899 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1e0081a0-94a2-4989-be9b-9840065e0ae4 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1461 microversion: 2.1 time: 0.242910 Feb 17 04:44:24.093493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 522/1056] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:23 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1461 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:24.111227 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-309813fe-93de-4e89-91bc-b46562da61ff tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b3d22e7b8>, body: {"pool": null} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:26.674178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-309813fe-93de-4e89-91bc-b46562da61ff tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.566749 Feb 17 04:44:26.675029 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 535/1057] 10.222.0.73 () {60 vars in 1160 bytes} [Wed Feb 17 04:44:24 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:26.688384 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.2.174"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:26.690224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:26.698993 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:26.699617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:26.700891 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:26.701385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:26.767065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Acquired lock "refresh_cache-6069f33d-afb9-47ee-a8e0-0fcd27257701" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:44:28.558052 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Building network info cache for instance {{(pid=98221) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:44:28.566938 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-67fb6f65-7ae1-4252-9afb-1eb3c5b711e8 req-d96cf341-03ca-4a8e-97dd-8aa52a4617f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6069f33d-afb9-47ee-a8e0-0fcd27257701", "tag": "01cd63ef-7328-49da-8698-91a752e80431"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:28.568652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:28.568652 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:44:28.578278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-67fb6f65-7ae1-4252-9afb-1eb3c5b711e8 req-d96cf341-03ca-4a8e-97dd-8aa52a4617f9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:28.578778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-67fb6f65-7ae1-4252-9afb-1eb3c5b711e8 req-d96cf341-03ca-4a8e-97dd-8aa52a4617f9 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:28.596958 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-67fb6f65-7ae1-4252-9afb-1eb3c5b711e8 req-d96cf341-03ca-4a8e-97dd-8aa52a4617f9 service nova] Creating event network-changed:01cd63ef-7328-49da-8698-91a752e80431 for instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 on hv-cinder-75995 Feb 17 04:44:28.602242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-67fb6f65-7ae1-4252-9afb-1eb3c5b711e8 req-d96cf341-03ca-4a8e-97dd-8aa52a4617f9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039195 Feb 17 04:44:28.603098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 536/1058] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:30.443194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Updating instance_info_cache with network_info: [{"id": "01cd63ef-7328-49da-8698-91a752e80431", "address": "fa:16:3e:69:0c:a6", "network": {"id": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2119822527-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a8d0b5722b8d4bcda86ec7e0d58ea9ec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap01cd63ef-73", "ovs_interfaceid": "01cd63ef-7328-49da-8698-91a752e80431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98221) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:44:30.501525 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Releasing lock "refresh_cache-6069f33d-afb9-47ee-a8e0-0fcd27257701" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:44:30.502500 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a73843f2-0d0d-4753-9337-90dc3165c93c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701/action" status: 202 len: 0 microversion: 2.1 time: 3.819734 Feb 17 04:44:30.503190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 523/1059] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:44:26 2021] POST /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701/action => generated 0 bytes in 3821 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:45:40.972334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:45:40.972901 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:45:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:46:17.701518 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:17.702181 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:17.711131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:17.711670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:17.712521 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:17.713027 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:17.778273 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:46:18.016514 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a2fbef27-fb6f-449a-9a2a-c721c3d1f12e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 204 len: 0 microversion: 2.1 time: 0.319926 Feb 17 04:46:18.017170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 537/1060] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:46:17 2021] DELETE /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:46:18.023721 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642a5820-29c9-427e-a770-425f23a5e057] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:46:18.027321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:18.027996 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:18.036242 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:18.036753 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:18.037581 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:18.038070 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:18.251099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:18.260679 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3f0cd1b8-8944-449f-a871-2869020bab05 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1586 microversion: 2.1 time: 0.238671 Feb 17 04:46:18.261289 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 524/1061] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:18 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1586 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:19.279733 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:19.280572 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:19.288969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:19.289757 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:19.290433 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:19.290979 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:19.510756 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:19.519984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-04e44508-2921-4ec6-aafe-04caae358d17 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1586 microversion: 2.1 time: 0.244922 Feb 17 04:46:19.520593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 538/1062] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:19 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1586 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:20.540310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:20.540997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:20.559860 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:20.560367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:20.561215 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:20.561709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:20.624166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] [642a5820-29c9-427e-a770-425f23a5e057] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56626. Feb 17 04:46:20.691785 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:20.702516 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8c72a1f6-02c8-42f8-8411-50f5fbd9e7ef tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1512 microversion: 2.1 time: 0.166897 Feb 17 04:46:20.708968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 525/1063] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:20 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:21.645592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-d6201a4f-0321-48ff-aade-5c642349df47 req-811d543d-e3a4-4763-aea7-843cbf878f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6069f33d-afb9-47ee-a8e0-0fcd27257701", "name": "network-vif-deleted", "tag": "01cd63ef-7328-49da-8698-91a752e80431"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:21.647594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:21.647594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:46:21.659161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d6201a4f-0321-48ff-aade-5c642349df47 req-811d543d-e3a4-4763-aea7-843cbf878f17 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:21.659921 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-d6201a4f-0321-48ff-aade-5c642349df47 req-811d543d-e3a4-4763-aea7-843cbf878f17 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:21.679626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-d6201a4f-0321-48ff-aade-5c642349df47 req-811d543d-e3a4-4763-aea7-843cbf878f17 service nova] Creating event network-vif-deleted:01cd63ef-7328-49da-8698-91a752e80431 for instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 on hv-cinder-75995 Feb 17 04:46:21.685143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-d6201a4f-0321-48ff-aade-5c642349df47 req-811d543d-e3a4-4763-aea7-843cbf878f17 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338793 Feb 17 04:46:21.686031 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 539/1064] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:46:21.721787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:21.722454 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:21.731206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:21.731746 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:21.732584 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:21.733073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:21.911102 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:21.921191 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-da980e0e-6bc4-4bb0-9379-08359834b2fa tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 200 len: 1226 microversion: 2.1 time: 0.203411 Feb 17 04:46:21.921826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 526/1065] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:21 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 1226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:22.940284 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:22.941064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:22.949768 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:22.950285 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:22.951177 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:22.951713 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:23.005409 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] HTTP exception thrown: Instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 could not be found. Feb 17 04:46:23.006148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Returning 404 to user: Instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:46:23.007076 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fad6e335-d38f-4ee5-80ee-3a69dd2b6b14 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 404 len: 111 microversion: 2.1 time: 0.071629 Feb 17 04:46:23.007820 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 540/1066] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:22 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:46:23.122480 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-127369421", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1321970644", "security_groups": [{"name": "tempest-TestVolumeBootPattern-511321096"}], "block_device_mapping_v2": [{"uuid": "80679f58-59f7-4599-a6d8-fb353fb5fc98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:23.295269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] validate_networks() for [('4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:46:23.882006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:46:23.882541 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:46:23.883039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:46:23.883532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:46:23.884001 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:46:23.893161 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:23.893674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:23.894557 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:23.895055 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:23.914648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:46:23.919064 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for user af5ffc1a33c849b69068092abe9f6d88 and project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:46:24.029744 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:46:24.032378 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80679f58-59f7-4599-a6d8-fb353fb5fc98',volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:46:24.320873 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-500cf1a0-5178-474f-a430-918d57ff90e1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.202328 Feb 17 04:46:24.321543 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 527/1067] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:46:23 2021] POST /compute/v2.1/servers => generated 412 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:46:24.332491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8f6c7d1c-9435-49ae-b407-b4a3b5cc9f24 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:24.333313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8f6c7d1c-9435-49ae-b407-b4a3b5cc9f24 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:24.429965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-8f6c7d1c-9435-49ae-b407-b4a3b5cc9f24 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:24.429965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8f6c7d1c-9435-49ae-b407-b4a3b5cc9f24 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1094 microversion: 2.1 time: 0.098513 Feb 17 04:46:24.429965 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 541/1068] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:24 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:25.446206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:25.446880 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:25.455507 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:25.457554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:25.457554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:25.457554 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:25.589461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:25.598512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4ae0a715-efad-4e80-ba03-a1dd4cfa75dc tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1136 microversion: 2.1 time: 0.156352 Feb 17 04:46:25.599131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 528/1069] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:25 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1136 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:26.619190 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:26.619824 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:26.631411 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:26.631944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:26.632779 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:26.633276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:26.761956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:26.770984 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4b66d3a1-a380-4ebd-ac6d-c2fb3ed40339 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1210 microversion: 2.1 time: 0.156833 Feb 17 04:46:26.771745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 542/1070] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:26 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:27.790408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:27.791018 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:27.799403 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:27.799920 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:27.800766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:27.801266 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:28.408293 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:28.420426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-08a246db-ef57-4e9f-815e-451d4531987c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.631659 Feb 17 04:46:28.420426 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 529/1071] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:27 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:29.159224 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-3dc98e3c-6b94-40e8-8f22-a3600354c6af req-d34bbde7-0c65-4588-8f74-126a6602ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6f2685-1148-47be-8e13-d7f933298f14", "tag": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:29.160893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:29.160893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:46:29.169883 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3dc98e3c-6b94-40e8-8f22-a3600354c6af req-d34bbde7-0c65-4588-8f74-126a6602ab87 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:29.170386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3dc98e3c-6b94-40e8-8f22-a3600354c6af req-d34bbde7-0c65-4588-8f74-126a6602ab87 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:29.188882 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-3dc98e3c-6b94-40e8-8f22-a3600354c6af req-d34bbde7-0c65-4588-8f74-126a6602ab87 service nova] Creating event network-changed:945cdf51-bda0-4690-9a1a-7d34a6eebb4d for instance ad6f2685-1148-47be-8e13-d7f933298f14 on hv-cinder-75995 Feb 17 04:46:29.194816 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-3dc98e3c-6b94-40e8-8f22-a3600354c6af req-d34bbde7-0c65-4588-8f74-126a6602ab87 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039681 Feb 17 04:46:29.195498 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 543/1072] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:29.437158 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:29.437731 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:29.446439 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:29.446949 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:29.447846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:29.448421 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:29.783655 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:29.793137 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e461de03-5a47-470d-883c-fdddf9682701 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.360445 Feb 17 04:46:29.793743 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 530/1073] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:29 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:30.813170 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:30.813967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:30.823008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:30.823558 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:30.824408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:30.824908 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:31.037452 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:31.046264 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-380bbe2d-8000-497c-aa23-256bd42d0532 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.237663 Feb 17 04:46:31.046865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 544/1074] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:30 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:32.064981 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:32.065649 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:32.073997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:32.074499 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:32.075373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:32.075966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:32.285448 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:32.294195 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1efe1cf5-18d0-4fed-ba76-2b5105ef4149 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.233285 Feb 17 04:46:32.294797 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 531/1075] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:32 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:33.312827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:33.313588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:33.321968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:33.322491 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:33.323357 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:33.323861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:33.537762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:33.546512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ab161041-ec42-4f22-bd18-eafc774d2ce3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.237756 Feb 17 04:46:33.547116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 545/1076] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:33 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:34.565067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:34.565787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:34.573837 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:34.581563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:34.581563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:34.581563 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:34.799897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:34.809269 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-acd0616b-a12a-4385-9ff5-4d7ae0b725da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.248774 Feb 17 04:46:34.809893 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 532/1077] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:34 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:35.829213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:35.829931 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:35.837853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:35.838365 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:35.839216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:35.839750 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:36.086006 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:36.095571 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fd3b7283-160d-4567-92a2-f387e06f359e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.270302 Feb 17 04:46:36.096183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 546/1078] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:35 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:46:37.118089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:37.118764 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:37.126711 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:37.127226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:37.128100 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:37.128599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:37.334099 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:37.342878 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-177aef51-b1df-4a75-ad97-a7c123b0593b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.229568 Feb 17 04:46:37.343504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 533/1079] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:37 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:38.117909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-f8506cb3-d49c-4e11-a185-7c99c916eba9 req-88e330d0-126c-4e6f-a8b3-1e85aa512125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6f2685-1148-47be-8e13-d7f933298f14", "name": "network-vif-plugged", "status": "completed", "tag": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:38.119605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:38.119605 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:46:38.128645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f8506cb3-d49c-4e11-a185-7c99c916eba9 req-88e330d0-126c-4e6f-a8b3-1e85aa512125 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:38.129145 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-f8506cb3-d49c-4e11-a185-7c99c916eba9 req-88e330d0-126c-4e6f-a8b3-1e85aa512125 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:38.148160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-f8506cb3-d49c-4e11-a185-7c99c916eba9 req-88e330d0-126c-4e6f-a8b3-1e85aa512125 service nova] Creating event network-vif-plugged:945cdf51-bda0-4690-9a1a-7d34a6eebb4d for instance ad6f2685-1148-47be-8e13-d7f933298f14 on hv-cinder-75995 Feb 17 04:46:38.153692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-f8506cb3-d49c-4e11-a185-7c99c916eba9 req-88e330d0-126c-4e6f-a8b3-1e85aa512125 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101158 Feb 17 04:46:38.154367 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 547/1080] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:38.361609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:38.362202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:38.370654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:38.371162 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:38.372024 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:38.372614 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:38.683470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:38.692566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1a313fa1-7ca1-4cd6-b678-6ccb14385d40 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.335067 Feb 17 04:46:38.693188 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 534/1081] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:38 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:39.713043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:39.713778 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:39.721936 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:39.722456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:39.723324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:39.723842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:39.940542 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:39.950067 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-df220257-4693-433b-927a-a7eb5f880d34 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1272 microversion: 2.1 time: 0.241755 Feb 17 04:46:39.950707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 548/1082] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:39 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:40.968344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:40.969008 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:40.976862 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:40.977362 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:40.978194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:40.978680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.188566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:41.197703 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-18df0981-bd58-45d8-ae90-53c7130cd2da tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1460 microversion: 2.1 time: 0.233306 Feb 17 04:46:41.198334 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 535/1083] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:40 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1460 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:41.215272 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:41.215967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:41.227103 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:41.227623 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.228488 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:41.228991 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.447662 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:41.457492 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ce6e4ea6-d5eb-4934-851d-c9254c21d139 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1460 microversion: 2.1 time: 0.246055 Feb 17 04:46:41.458131 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 549/1084] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:41 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1460 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:41.475812 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-0b30c789-cff0-43e5-a61f-f4b16c65438f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b3db51e18>, body: {"pool": null} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:43.986966 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-0b30c789-cff0-43e5-a61f-f4b16c65438f tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.515263 Feb 17 04:46:43.987686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 536/1085] 10.222.0.73 () {60 vars in 1160 bytes} [Wed Feb 17 04:46:41 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:43.999948 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.2.209"}} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:44.001204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:44.009637 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:44.010155 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:44.010997 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:44.011531 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:44.075961 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Acquired lock "refresh_cache-ad6f2685-1148-47be-8e13-d7f933298f14" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:46:46.121108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Building network info cache for instance {{(pid=98222) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:46:46.194538 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-b6bfbab6-68ff-418f-b2ca-af76653e4f1f req-e08c3054-3f52-4e5c-a048-37748276d8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6f2685-1148-47be-8e13-d7f933298f14", "tag": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:46.196471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:46.196471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:46:46.206614 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b6bfbab6-68ff-418f-b2ca-af76653e4f1f req-e08c3054-3f52-4e5c-a048-37748276d8df service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:46.207135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-b6bfbab6-68ff-418f-b2ca-af76653e4f1f req-e08c3054-3f52-4e5c-a048-37748276d8df service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:46.227705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-b6bfbab6-68ff-418f-b2ca-af76653e4f1f req-e08c3054-3f52-4e5c-a048-37748276d8df service nova] Creating event network-changed:945cdf51-bda0-4690-9a1a-7d34a6eebb4d for instance ad6f2685-1148-47be-8e13-d7f933298f14 on hv-cinder-75995 Feb 17 04:46:46.236196 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-b6bfbab6-68ff-418f-b2ca-af76653e4f1f req-e08c3054-3f52-4e5c-a048-37748276d8df service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110564 Feb 17 04:46:46.236968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 537/1086] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:47.140228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Updating instance_info_cache with network_info: [{"id": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d", "address": "fa:16:3e:a1:57:8a", "network": {"id": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2119822527-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a8d0b5722b8d4bcda86ec7e0d58ea9ec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap945cdf51-bd", "ovs_interfaceid": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98222) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:46:47.149408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Releasing lock "refresh_cache-ad6f2685-1148-47be-8e13-d7f933298f14" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:46:47.150344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-276382f0-a01d-4077-a6ea-d3093ec52653 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14/action" status: 202 len: 0 microversion: 2.1 time: 3.155146 Feb 17 04:46:47.151007 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 550/1087] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:46:43 2021] POST /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14/action => generated 0 bytes in 3156 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:48:13.485168 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1324780206", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1321970644", "security_groups": [{"name": "tempest-TestVolumeBootPattern-511321096"}], "block_device_mapping_v2": [{"uuid": "f80c4164-627a-46d3-9653-09527359007e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa"}]}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:13.659167 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] validate_networks() for [('4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa', None, None, None)] {{(pid=98221) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:48:14.285766 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Flavor limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:48:14.286248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Image limits 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:48:14.286798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Flavor pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:48:14.287333 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Image pref 0:0:0 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:48:14.287843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.virt.hardware [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:48:14.296950 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:14.297462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:14.298342 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:14.298841 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:14.317226 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:48:14.321540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.quota [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Getting quotas for user af5ffc1a33c849b69068092abe9f6d88 and project a8d0b5722b8d4bcda86ec7e0d58ea9ec. Resources: {'instances', 'cores', 'ram'} {{(pid=98221) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:48:14.428248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Going to run 1 instances... {{(pid=98221) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:48:14.430914 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f80c4164-627a-46d3-9653-09527359007e',volume_size=None,volume_type=None)] {{(pid=98221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:48:14.749290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a17ec65c-987d-4e30-895f-64ee60ce6cd9 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.269010 Feb 17 04:48:14.750009 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 538/1088] 10.222.0.73 () {60 vars in 1137 bytes} [Wed Feb 17 04:48:13 2021] POST /compute/v2.1/servers => generated 412 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:48:14.761478 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f70f80f0-d8db-48e0-975a-de9e50bb1841 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:14.762249 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f70f80f0-d8db-48e0-975a-de9e50bb1841 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:14.767043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5215aa1f-4f45-4223-bf01-13cab2c158be] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:48:14.845087 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f70f80f0-d8db-48e0-975a-de9e50bb1841 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:14.854021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f70f80f0-d8db-48e0-975a-de9e50bb1841 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1095 microversion: 2.1 time: 0.096545 Feb 17 04:48:14.854826 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 551/1089] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:14 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:15.873039 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:15.873709 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:15.882455 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:15.882987 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:15.883857 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:15.884352 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:16.016559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:16.026451 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-6aa1cb2c-9752-4eab-bcb1-2a75416bc8eb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1193 microversion: 2.1 time: 0.157472 Feb 17 04:48:16.027061 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 539/1090] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:15 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1193 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:17.054255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:17.054900 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:17.075674 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:17.076185 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:17.077043 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:17.077532 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:17.134593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] [5215aa1f-4f45-4223-bf01-13cab2c158be] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56782. Feb 17 04:48:17.210121 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:17.220045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-7afa3816-d1c2-4d17-bf37-bafb3a237dee tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1211 microversion: 2.1 time: 0.169849 Feb 17 04:48:17.220672 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 552/1091] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:17 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1211 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:18.237804 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:18.238477 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:18.246331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:18.246846 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:18.247722 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:18.248220 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:18.778886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:18.788493 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-11c5f162-abe0-4110-9559-3c7c3422062a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.554735 Feb 17 04:48:18.789461 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 540/1092] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:18 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:19.402350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-07bb9cb0-2267-4902-915a-fbb3e4c66aa5 req-9f73aeab-81e8-4243-bea3-ad8a62301a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c64bda-2b25-4fd4-8466-b6228dc40754", "tag": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:19.407503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:48:19.407503 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:48:19.413456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-07bb9cb0-2267-4902-915a-fbb3e4c66aa5 req-9f73aeab-81e8-4243-bea3-ad8a62301a0e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:19.413960 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-07bb9cb0-2267-4902-915a-fbb3e4c66aa5 req-9f73aeab-81e8-4243-bea3-ad8a62301a0e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:19.433565 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-07bb9cb0-2267-4902-915a-fbb3e4c66aa5 req-9f73aeab-81e8-4243-bea3-ad8a62301a0e service nova] Creating event network-changed:d32c47a8-1193-4774-b0e9-c91b3e5fac4f for instance e8c64bda-2b25-4fd4-8466-b6228dc40754 on hv-cinder-75995 Feb 17 04:48:19.438809 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-07bb9cb0-2267-4902-915a-fbb3e4c66aa5 req-9f73aeab-81e8-4243-bea3-ad8a62301a0e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040334 Feb 17 04:48:19.440026 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 553/1093] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:48:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:19.807005 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:19.807798 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:19.815754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:19.816274 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:19.817126 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:19.817626 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:20.180138 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:20.189724 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-e3301698-3e51-4129-8920-6c01f69b3f03 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.387326 Feb 17 04:48:20.190344 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 541/1094] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:19 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:21.208156 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:21.208968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:21.217081 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:21.217599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:21.218443 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:21.218956 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:21.429930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:21.439427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-95f429c0-df2f-4163-a704-3bfe7d8b947a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.235836 Feb 17 04:48:21.440030 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 554/1095] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:21 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:22.458206 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:22.458879 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:22.467843 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:22.468354 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:22.470995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:22.470995 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:22.686487 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:22.695599 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-5b60c5c8-c5fd-4ef3-8acc-1442c34391e0 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.241409 Feb 17 04:48:22.696203 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 542/1096] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:22 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:23.714676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:23.715540 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:23.723422 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:23.723932 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:23.724772 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:23.725276 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:23.937705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:23.946576 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fe5df3b3-48c8-486f-9151-04d96d054a07 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.236520 Feb 17 04:48:23.947700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 555/1097] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:23 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:24.965670 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:24.966346 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:24.974233 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:24.974737 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:24.975603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:24.976098 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:25.188052 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:25.197020 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f260f855-8d4b-4be8-b7af-4350894e6475 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.235967 Feb 17 04:48:25.197851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 543/1098] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:24 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:26.215110 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:26.215842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:26.223736 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:26.224244 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:26.225077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:26.225569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:26.438052 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:26.446842 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-b09f8f8a-23df-4862-a5b8-581a4bb352de tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.235791 Feb 17 04:48:26.447466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 556/1099] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:26 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:27.465698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:27.466397 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:27.474192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:27.474702 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:27.475585 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:27.476075 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:27.684758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:27.693858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-231d8996-a9b1-4a5c-aa37-a65a98f9deea tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.232219 Feb 17 04:48:27.694462 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 544/1100] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:27 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:28.711124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:28.711848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:28.720104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:28.720622 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:28.721467 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:28.721969 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:28.852391 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-ebaa349f-d224-43a0-a9f5-cd14d637a71f req-852225b1-0f9d-4891-af3d-87007a6f0924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c64bda-2b25-4fd4-8466-b6228dc40754", "name": "network-vif-plugged", "status": "completed", "tag": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:28.854238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:48:28.854238 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:48:28.863300 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-ebaa349f-d224-43a0-a9f5-cd14d637a71f req-852225b1-0f9d-4891-af3d-87007a6f0924 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:28.868714 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-ebaa349f-d224-43a0-a9f5-cd14d637a71f req-852225b1-0f9d-4891-af3d-87007a6f0924 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:28.882412 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-ebaa349f-d224-43a0-a9f5-cd14d637a71f req-852225b1-0f9d-4891-af3d-87007a6f0924 service nova] Creating event network-vif-plugged:d32c47a8-1193-4774-b0e9-c91b3e5fac4f for instance e8c64bda-2b25-4fd4-8466-b6228dc40754 on hv-cinder-75995 Feb 17 04:48:28.888617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-ebaa349f-d224-43a0-a9f5-cd14d637a71f req-852225b1-0f9d-4891-af3d-87007a6f0924 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040256 Feb 17 04:48:28.889373 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 545/1101] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:48:28.949587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:28.958593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ecdb2fa9-4208-4c78-8d09-9f5c357d8b5a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.251576 Feb 17 04:48:28.959202 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 557/1102] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:28 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:29.977408 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:29.978178 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:29.986413 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:29.986928 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:29.987792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:29.988290 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:30.199122 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:30.207827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-1df80b0b-37f7-4f26-8611-5aeac539613e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1273 microversion: 2.1 time: 0.234897 Feb 17 04:48:30.208406 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 546/1103] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:29 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:31.226114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:31.226792 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:31.234740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:31.235255 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:31.236148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:31.236645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:31.449348 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:31.458216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f87da7cc-a4cd-4ce3-9856-b0a04415ae8d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1460 microversion: 2.1 time: 0.236215 Feb 17 04:48:31.458814 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 558/1104] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:31 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1460 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:31.475316 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:31.475983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:31.484330 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:31.484791 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:31.485658 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:31.486128 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:31.697653 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:31.706726 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-de048548-c461-40c8-9f32-6e8570446230 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1460 microversion: 2.1 time: 0.235383 Feb 17 04:48:31.707350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 547/1105] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:31 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1460 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:31.725127 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-09fa6ec6-88d6-4af7-a50e-a3c7d8d34098 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'create', calling method: .version_select at 0x7f9b2fc70ea0>, body: {"pool": null} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:34.294567 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-09fa6ec6-88d6-4af7-a50e-a3c7d8d34098 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.573400 Feb 17 04:48:34.295228 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 559/1106] 10.222.0.73 () {60 vars in 1160 bytes} [Wed Feb 17 04:48:31 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:34.307676 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.2.133"}} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:34.308975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:34.317074 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:34.317593 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:34.318436 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:34.318930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:34.382758 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Acquired lock "refresh_cache-e8c64bda-2b25-4fd4-8466-b6228dc40754" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:48:36.356545 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Building network info cache for instance {{(pid=98221) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:48:36.365553 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-2564d194-5c3a-4bcb-91ef-ed534c1641f3 req-3c304724-3a25-4d02-88b5-0a398298d07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c64bda-2b25-4fd4-8466-b6228dc40754", "tag": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:36.367609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:48:36.367609 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:48:36.378065 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-2564d194-5c3a-4bcb-91ef-ed534c1641f3 req-3c304724-3a25-4d02-88b5-0a398298d07c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:36.378865 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-2564d194-5c3a-4bcb-91ef-ed534c1641f3 req-3c304724-3a25-4d02-88b5-0a398298d07c service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:36.396486 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-2564d194-5c3a-4bcb-91ef-ed534c1641f3 req-3c304724-3a25-4d02-88b5-0a398298d07c service nova] Creating event network-changed:d32c47a8-1193-4774-b0e9-c91b3e5fac4f for instance e8c64bda-2b25-4fd4-8466-b6228dc40754 on hv-cinder-75995 Feb 17 04:48:36.402328 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-2564d194-5c3a-4bcb-91ef-ed534c1641f3 req-3c304724-3a25-4d02-88b5-0a398298d07c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040641 Feb 17 04:48:36.403386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 560/1107] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:48:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:37.802386 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Updating instance_info_cache with network_info: [{"id": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f", "address": "fa:16:3e:1e:d3:a6", "network": {"id": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2119822527-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.2.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a8d0b5722b8d4bcda86ec7e0d58ea9ec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd32c47a8-11", "ovs_interfaceid": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98221) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:48:37.841248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Releasing lock "refresh_cache-e8c64bda-2b25-4fd4-8466-b6228dc40754" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:48:37.843104 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a3efd790-4250-4559-a739-7dd7233bf8a3 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "POST /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754/action" status: 202 len: 0 microversion: 2.1 time: 3.539685 Feb 17 04:48:37.844147 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 548/1108] 10.222.0.73 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:34 2021] POST /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754/action => generated 0 bytes in 3542 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:48:47.166611 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:48:47.167213 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:48:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:49:00.990385 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:49:00.991025 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:49:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:49:04.487959 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:49:04.488471 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:49:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:50:04.088459 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '.version_select at 0x7f9b2fc70510>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:04.587200 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:04.595897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:04.596407 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:04.597256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:04.597754 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:04.661204 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Acquired lock "refresh_cache-e8c64bda-2b25-4fd4-8466-b6228dc40754" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:50:06.777811 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Building network info cache for instance {{(pid=98222) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:50:06.788133 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-fdd5df24-9e2e-4f3e-9432-4def96c2b534 req-54335795-d0a3-4a81-a1ea-c917da557fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c64bda-2b25-4fd4-8466-b6228dc40754", "tag": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:06.790114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:06.790114 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:50:06.800192 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-fdd5df24-9e2e-4f3e-9432-4def96c2b534 req-54335795-d0a3-4a81-a1ea-c917da557fd7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:06.800941 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-fdd5df24-9e2e-4f3e-9432-4def96c2b534 req-54335795-d0a3-4a81-a1ea-c917da557fd7 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:06.819231 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-fdd5df24-9e2e-4f3e-9432-4def96c2b534 req-54335795-d0a3-4a81-a1ea-c917da557fd7 service nova] Creating event network-changed:d32c47a8-1193-4774-b0e9-c91b3e5fac4f for instance e8c64bda-2b25-4fd4-8466-b6228dc40754 on hv-cinder-75995 Feb 17 04:50:06.824957 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-fdd5df24-9e2e-4f3e-9432-4def96c2b534 req-54335795-d0a3-4a81-a1ea-c917da557fd7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Feb 17 04:50:06.825775 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 549/1109] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:50:07.604387 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Updating instance_info_cache with network_info: [{"id": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f", "address": "fa:16:3e:1e:d3:a6", "network": {"id": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2119822527-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a8d0b5722b8d4bcda86ec7e0d58ea9ec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd32c47a8-11", "ovs_interfaceid": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98222) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:50:07.648765 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Releasing lock "refresh_cache-e8c64bda-2b25-4fd4-8466-b6228dc40754" {{(pid=98222) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:50:07.649752 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2100cb65-a6bd-49f4-9416-b92bbd807cd2 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/12db6cb3-4878-4aa1-a24e-9a1f1cefc689" status: 202 len: 0 microversion: 2.1 time: 3.566049 Feb 17 04:50:07.650594 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 561/1110] 10.222.0.73 () {58 vars in 1253 bytes} [Wed Feb 17 04:50:04 2021] DELETE /compute/v2.1/os-floating-ips/12db6cb3-4878-4aa1-a24e-9a1f1cefc689 => generated 0 bytes in 3568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:50:07.661504 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:07.662207 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:07.670633 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.671134 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:07.671989 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.672650 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:07.742848 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Going to try to terminate instance {{(pid=98221) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:50:07.957021 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-20391b70-de39-4663-8a04-343d47f57c77 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 204 len: 0 microversion: 2.1 time: 0.300554 Feb 17 04:50:07.957683 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 550/1111] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:50:07 2021] DELETE /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:50:07.966388 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:07.967072 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:07.978046 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.978559 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:07.979442 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.979944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:08.236852 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:08.246160 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-a5876841-e871-46ac-bc76-4682a1be2fab tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1466 microversion: 2.1 time: 0.283611 Feb 17 04:50:08.246707 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 562/1112] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:07 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:09.266154 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:09.266977 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:09.274930 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:09.275470 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:09.276310 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:09.276806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:09.585975 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:09.597466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-3fb96674-7922-4963-83cf-731b002968ca tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1466 microversion: 2.1 time: 0.335521 Feb 17 04:50:09.598089 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 551/1113] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:09 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1466 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:10.565506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-3e12e6bb-695a-43fa-acf4-386754ec882b req-112dc14a-4802-4e30-95cc-b7002b29fe38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c64bda-2b25-4fd4-8466-b6228dc40754", "name": "network-vif-deleted", "tag": "d32c47a8-1193-4774-b0e9-c91b3e5fac4f"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:10.565506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:10.565506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:50:10.565506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3e12e6bb-695a-43fa-acf4-386754ec882b req-112dc14a-4802-4e30-95cc-b7002b29fe38 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:10.565506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-3e12e6bb-695a-43fa-acf4-386754ec882b req-112dc14a-4802-4e30-95cc-b7002b29fe38 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:10.581278 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-3e12e6bb-695a-43fa-acf4-386754ec882b req-112dc14a-4802-4e30-95cc-b7002b29fe38 service nova] Creating event network-vif-deleted:d32c47a8-1193-4774-b0e9-c91b3e5fac4f for instance e8c64bda-2b25-4fd4-8466-b6228dc40754 on hv-cinder-75995 Feb 17 04:50:10.586907 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-3e12e6bb-695a-43fa-acf4-386754ec882b req-112dc14a-4802-4e30-95cc-b7002b29fe38 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039724 Feb 17 04:50:10.587587 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 563/1114] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:10.615828 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:10.616654 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:10.624909 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:10.628861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:10.628861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:10.628861 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:10.805077 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:10.813943 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-f4b93228-bac5-4262-bf25-ede28a8b9514 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 200 len: 1226 microversion: 2.1 time: 0.202180 Feb 17 04:50:10.814549 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 552/1115] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:10 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 1226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:11.832129 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:11.832851 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: e8c64bda-2b25-4fd4-8466-b6228dc40754] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:11.841166 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:11.841760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:11.842706 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:11.843216 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:11.897628 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] HTTP exception thrown: Instance e8c64bda-2b25-4fd4-8466-b6228dc40754 could not be found. Feb 17 04:50:11.898318 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Returning 404 to user: Instance e8c64bda-2b25-4fd4-8466-b6228dc40754 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:50:11.899248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-cebc03d9-5350-4312-bc19-9be3c8501667 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754" status: 404 len: 111 microversion: 2.1 time: 0.071959 Feb 17 04:50:11.899910 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 564/1116] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:11 2021] GET /compute/v2.1/servers/e8c64bda-2b25-4fd4-8466-b6228dc40754 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:50:14.412566 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '.version_select at 0x7f9b2feb22f0>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:15.140678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:15.148858 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:15.149350 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:15.150210 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:15.151045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:15.213506 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Acquired lock "refresh_cache-ad6f2685-1148-47be-8e13-d7f933298f14" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:50:17.238392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Building network info cache for instance {{(pid=98221) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:50:17.247827 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-e29c4353-1ae6-4ba2-909c-bfab56fa98bf req-d9f537d1-f0eb-4300-b8cf-21893fb0bf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6f2685-1148-47be-8e13-d7f933298f14", "tag": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d"}]} {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:17.249476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:17.249476 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:50:17.260446 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-e29c4353-1ae6-4ba2-909c-bfab56fa98bf req-d9f537d1-f0eb-4300-b8cf-21893fb0bf31 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:17.261474 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-e29c4353-1ae6-4ba2-909c-bfab56fa98bf req-d9f537d1-f0eb-4300-b8cf-21893fb0bf31 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:17.279884 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-e29c4353-1ae6-4ba2-909c-bfab56fa98bf req-d9f537d1-f0eb-4300-b8cf-21893fb0bf31 service nova] Creating event network-changed:945cdf51-bda0-4690-9a1a-7d34a6eebb4d for instance ad6f2685-1148-47be-8e13-d7f933298f14 on hv-cinder-75995 Feb 17 04:50:17.285610 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-e29c4353-1ae6-4ba2-909c-bfab56fa98bf req-d9f537d1-f0eb-4300-b8cf-21893fb0bf31 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041907 Feb 17 04:50:17.286535 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 565/1117] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:50:18.893947 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.network.neutron [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Updating instance_info_cache with network_info: [{"id": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d", "address": "fa:16:3e:a1:57:8a", "network": {"id": "4c593f7c-0bdf-4c8b-80da-1acd6a9eabaa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2119822527-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a8d0b5722b8d4bcda86ec7e0d58ea9ec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap945cdf51-bd", "ovs_interfaceid": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98221) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:50:18.950435 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Releasing lock "refresh_cache-ad6f2685-1148-47be-8e13-d7f933298f14" {{(pid=98221) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:50:18.951431 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fa1756c1-d8e9-44c6-9b16-9dfb5667f988 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/1b4a577c-d231-4f29-9870-3e3db5753488" status: 202 len: 0 microversion: 2.1 time: 4.543047 Feb 17 04:50:18.952083 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 553/1118] 10.222.0.73 () {58 vars in 1253 bytes} [Wed Feb 17 04:50:14 2021] DELETE /compute/v2.1/os-floating-ips/1b4a577c-d231-4f29-9870-3e3db5753488 => generated 0 bytes in 4544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:50:18.961669 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:18.962321 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:18.970603 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:18.971108 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:18.972512 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:18.973045 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:19.043739 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Going to try to terminate instance {{(pid=98222) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:50:19.305331 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-57298221-721f-4543-9188-f5a9ca79e00c tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 204 len: 0 microversion: 2.1 time: 0.347818 Feb 17 04:50:19.305913 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 566/1119] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:50:18 2021] DELETE /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:50:19.314717 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:19.316194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:19.323944 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:19.324444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:19.325275 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:19.325787 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:19.591444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98221) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:19.600978 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-904056db-e10e-4eac-b69f-ab4eca75ea9d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1466 microversion: 2.1 time: 0.290391 Feb 17 04:50:19.601588 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 554/1120] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:19 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1466 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:20.620690 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:20.621468 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:20.629450 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:20.629962 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:20.630806 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:20.631313 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:20.843853 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:20.853678 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-fbf6fa8b-9175-45b1-b715-9be5ed86ff2a tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1466 microversion: 2.1 time: 0.237489 Feb 17 04:50:20.854617 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 567/1121] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:20 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1466 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:21.163631 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-bd40ef60-dfde-4647-b089-b07a3c0406bc req-eb6815c7-6478-45f2-b1ab-f4ade712ef2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6f2685-1148-47be-8e13-d7f933298f14", "name": "network-vif-unplugged", "status": "completed", "tag": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:21.165427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:21.165427 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:50:21.171445 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642a5820-29c9-427e-a770-425f23a5e057] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Feb 17 04:50:21.180042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-bd40ef60-dfde-4647-b089-b07a3c0406bc req-eb6815c7-6478-45f2-b1ab-f4ade712ef2e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:21.180042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-bd40ef60-dfde-4647-b089-b07a3c0406bc req-eb6815c7-6478-45f2-b1ab-f4ade712ef2e service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:21.193952 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-bd40ef60-dfde-4647-b089-b07a3c0406bc req-eb6815c7-6478-45f2-b1ab-f4ade712ef2e service nova] Creating event network-vif-unplugged:945cdf51-bda0-4690-9a1a-7d34a6eebb4d for instance ad6f2685-1148-47be-8e13-d7f933298f14 on hv-cinder-75995 Feb 17 04:50:21.199680 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-bd40ef60-dfde-4647-b089-b07a3c0406bc req-eb6815c7-6478-45f2-b1ab-f4ade712ef2e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041732 Feb 17 04:50:21.201090 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 555/1122] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:21.873073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:21.873661 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:21.881625 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:21.882135 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:21.882983 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:21.883511 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:22.104695 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:22.113740 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-31b17890-6162-488b-9011-eeeacd0a4c1d tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1466 microversion: 2.1 time: 0.244757 Feb 17 04:50:22.114347 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 568/1123] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:21 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:22.993834 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [req-8673196e-9138-461f-994d-1736a9445c62 req-5dc16579-93a8-42ae-89cb-4abcc6895588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6f2685-1148-47be-8e13-d7f933298f14", "name": "network-vif-deleted", "tag": "945cdf51-bda0-4690-9a1a-7d34a6eebb4d"}]} {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:22.995444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:22.995444 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: warnings.warn(msg) Feb 17 04:50:23.005745 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8673196e-9138-461f-994d-1736a9445c62 req-5dc16579-93a8-42ae-89cb-4abcc6895588 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:23.006248 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [req-8673196e-9138-461f-994d-1736a9445c62 req-5dc16579-93a8-42ae-89cb-4abcc6895588 service nova] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:23.023885 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.compute.server_external_events [req-8673196e-9138-461f-994d-1736a9445c62 req-5dc16579-93a8-42ae-89cb-4abcc6895588 service nova] Creating event network-vif-deleted:945cdf51-bda0-4690-9a1a-7d34a6eebb4d for instance ad6f2685-1148-47be-8e13-d7f933298f14 on hv-cinder-75995 Feb 17 04:50:23.027645 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] [642a5820-29c9-427e-a770-425f23a5e057] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56902. Feb 17 04:50:23.029256 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [req-8673196e-9138-461f-994d-1736a9445c62 req-5dc16579-93a8-42ae-89cb-4abcc6895588 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051668 Feb 17 04:50:23.029902 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 556/1124] 10.222.0.73 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:23.132968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:23.133641 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:23.141730 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:23.142240 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:23.143093 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:23.143660 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:23.419198 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.policy [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ffc1a33c849b69068092abe9f6d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0b5722b8d4bcda86ec7e0d58ea9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98222) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:23.429663 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-038e27d3-aee6-4c7c-aba2-1164780ab4d6 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 200 len: 1225 microversion: 2.1 time: 0.301260 Feb 17 04:50:23.440073 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 569/1125] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:23 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 1225 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:24.449038 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:24.449803 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: ad6f2685-1148-47be-8e13-d7f933298f14] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:24.458183 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:24.458697 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:24.459550 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:24.460042 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:24.514401 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] HTTP exception thrown: Instance ad6f2685-1148-47be-8e13-d7f933298f14 could not be found. Feb 17 04:50:24.515056 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Returning 404 to user: Instance ad6f2685-1148-47be-8e13-d7f933298f14 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:50:24.515972 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-599d1612-f6dd-4a64-b1cc-6df7aee47ebb tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14" status: 404 len: 111 microversion: 2.1 time: 0.071503 Feb 17 04:50:24.516569 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 557/1126] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:24 2021] GET /compute/v2.1/servers/ad6f2685-1148-47be-8e13-d7f933298f14 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:50:24.525592 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-c52c27ae-b285-47f1-8bf7-6864120a3e5e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '.version_select at 0x7f9b3d22e8c8>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:26.119705 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-c52c27ae-b285-47f1-8bf7-6864120a3e5e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/9071e158-6ed6-4bb4-ad6e-c547e41c4cd0" status: 202 len: 0 microversion: 2.1 time: 1.597935 Feb 17 04:50:26.120329 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 570/1127] 10.222.0.73 () {58 vars in 1253 bytes} [Wed Feb 17 04:50:24 2021] DELETE /compute/v2.1/os-floating-ips/9071e158-6ed6-4bb4-ad6e-c547e41c4cd0 => generated 0 bytes in 1599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:50:26.129143 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:26.129686 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98221) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:26.137635 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:26.138141 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.138967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:26.139488 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.192466 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] HTTP exception thrown: Instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 could not be found. Feb 17 04:50:26.193124 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Returning 404 to user: Instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 could not be found. {{(pid=98221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:50:26.194068 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-8513def1-c07b-4d1f-94fe-288a208877f1 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 404 len: 111 microversion: 2.1 time: 0.069074 Feb 17 04:50:26.194700 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 558/1128] 10.222.0.73 () {58 vars in 1229 bytes} [Wed Feb 17 04:50:26 2021] DELETE /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:50:26.204646 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:26.205324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.compute.api [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] [instance: 6069f33d-afb9-47ee-a8e0-0fcd27257701] Fetching instance by UUID {{(pid=98222) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:26.214340 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:26.214886 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.215769 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:26.216267 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG oslo_concurrency.lockutils [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Lock "ed6ce518-2f7d-44db-9afc-ecf963cec3c5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98222) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.268101 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.wsgi [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] HTTP exception thrown: Instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 could not be found. Feb 17 04:50:26.269363 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Returning 404 to user: Instance 6069f33d-afb9-47ee-a8e0-0fcd27257701 could not be found. {{(pid=98222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:50:26.270279 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-ae1a52e7-d682-461a-955b-52ae01d7fee7 tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701" status: 404 len: 111 microversion: 2.1 time: 0.070135 Feb 17 04:50:26.270897 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 571/1129] 10.222.0.73 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:26 2021] GET /compute/v2.1/servers/6069f33d-afb9-47ee-a8e0-0fcd27257701 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:50:27.585456 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-4259cfed-f70f-43a8-b476-23da9d18bf2e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '.version_select at 0x7f9b2feb4840>' {{(pid=98221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:27.941967 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-4259cfed-f70f-43a8-b476-23da9d18bf2e tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/fcc9b4cd-f53a-4367-ac89-10d39a04b2c8" status: 202 len: 0 microversion: 2.1 time: 0.361221 Feb 17 04:50:27.942657 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98221|app: 0|req: 559/1130] 10.222.0.73 () {58 vars in 1262 bytes} [Wed Feb 17 04:50:27 2021] DELETE /compute/v2.1/os-security-groups/fcc9b4cd-f53a-4367-ac89-10d39a04b2c8 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:50:27.951968 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: DEBUG nova.api.openstack.wsgi [None req-2a2b7aab-cf78-4d0e-afb7-921beb508a0b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] Calling method '.version_select at 0x7f9b3dcafd08>' {{(pid=98222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:27.998194 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO nova.api.openstack.requestlog [None req-2a2b7aab-cf78-4d0e-afb7-921beb508a0b tempest-TestVolumeBootPattern-1370121168 tempest-TestVolumeBootPattern-1370121168-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1321970644" status: 202 len: 0 microversion: 2.1 time: 0.050586 Feb 17 04:50:27.998832 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: [pid: 98222|app: 0|req: 572/1131] 10.222.0.73 () {58 vars in 1253 bytes} [Wed Feb 17 04:50:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1321970644 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:51:00.841080 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:51:00.841648 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:51:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:52:07.185324 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:52:07.185963 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:52:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:52:24.504616 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:52:24.505182 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:52:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:52:46.038212 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:52:46.038821 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:52:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:54:20.858762 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:54:20.859435 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:54:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:27.203692 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:27.204325 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:55:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:41.011107 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:41.011784 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:55:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:44.521760 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:44.522392 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:55:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:52.085116 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:52.085698 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:55:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:56:06.055555 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:56:06.056148 dv-cinder-759955-5-iscsi devstack@n-api.service[98220]: Wed Feb 17 04:56:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!